Compare the Full feed received from the Roster system with the Data Snapshot created by the AIP$\_$FDC$\_$ETL$\_$System on a tenant basis.

After comparing the files following analysis is to be derived from the original tenant$-$ specific roster full feed received:

$1.$ Tenant$\_$id

$2.$ Roster$\_$Full$\_$Feed$\_$file$\_$timestamp

$3.$ DataSnapshot$\_$file$\_$timestamp

$4.$ The total number of records received in roster full feed

$5.$ The Total number of new records received in roster full feed

$6.$ The Total number of records have different statuses in roster full feed

The roster full feed and data snapshot feeds reside in a different bucket.

The feeds should be individually read, joined, and compared using Apache PySpark job

I need to extract roster,data snapshot timestamp from filename $,$roster full feed is csv$,$data snapshot are paqrquet files