etl

Extraction

controlled validation step: after each iteration, have a systematic check to confirm that all expected fields reappear.