What happened: the files behind a run
MFT 4 · 3:44
Two records show what a transfer's runs moved: the journal has one row per file, and each run publishes a run record with its counts. You can read both in the admin UI and in the terminal.
What it covers
- The Transferred files page, with its search and its filters for the last 30 days
- The Transfers section on the transfer's own page
- The same rclone lines in the terminal with
weikio logs - The run record on the environment's event stream, with its counts of files, bytes and errors
- The Runs section, one row per run, and the view a row opens
- Listing runs with
weikio events listand printing one withweikio events show
Commands in this video
Terminal
$ weikio logs finance/supplier-invoices --env devtest
$ weikio events list --env devtest --family mft --integration supplier-invoices
$ weikio events show --env devtest --stream events --seq 2Transcript
- 0:02The transfer is shaped, and two runs have happened.
- 0:05This video reads what its two runs moved.
- 0:11The transfer runs in devtest, version 0.1.1 on agent dev.
- 0:17The supplier's FTP server holds the two PDFs and a price list.
- 0:24The archive bucket holds one PDF per run.
- 0:28The Transferred files page in the admin UI lists the files the transfers moved in the last 30 days,
- 0:34newest first.
- 0:36It has a file name search and filters for transfer,
- 0:39environment and status, and it says Last 30 days.
- 0:43The newest row is invoice-1042.pdf, Copied, its size, and the transfer it came from.
- 0:52This is the journal, one row per file. The price list has no row.
- 0:58On a transfer's own page, the same journal is the Transfers section.
- 1:04Its panel keeps the file name search and the All and Failed tabs,
- 1:08and its rows read Time, File, Action, Size and Agent.
- 1:14Here it shows the rows of the two runs, the newest first.
- 1:22The same facts are in the terminal, with weikio logs and the environment flag.
- 1:27Every line rclone writes is logged as it is written,
- 1:31and the file shows as Copied (new).
- 1:35Here the line names invoice-1042.pdf, its size, and rclone's message, at the end.
- 1:44Each run of the transfer publishes a record,
- 1:47and it sits on the environment's event stream.
- 1:50The run record sums the run up: when it started and when it ended.
- 1:55It also holds how many files, how many bytes and how many errors,
- 1:59and here the stream is events.
- 2:05In the admin UI, the transfer's page has a Runs section, one row per run.
- 2:11The columns of a row are Started, Duration, Transferred, Size, Errors and Operation.
- 2:19A row opens its own view: the details of the run, and the files it moved.
- 2:25Here the newest run copied one PDF in under a second, with no errors.
- 2:31On the terminal, weikio events list gives one line per run of the transfer,
- 2:36and the family flag picks the mft records.
- 2:40Each line shows the sequence, the number the record carries, its stream,
- 2:45the time, the family, the source, the agent and the size.
- 2:50The integration flag names the transfer, and the listing holds its two runs.
- 2:55The newest line prints its sequence, two, and the show command takes that number.
- 3:02The second command is weikio events show,
- 3:05and it prints one record by its sequence number.
- 3:08The subject names where the message was stored,
- 3:11and the headers name the transfer and its agent.
- 3:14The body is the record itself, pretty-printed: the start,
- 3:18the end, the files, the bytes and the errors.
- 3:24The journal is one row per file, read in the admin UI and in the terminal.
- 3:30The run record is one record per run, read in the Runs section and in the terminal.
Next in this track
MFT 5 · 3:59 To production Watched