Basis: sourced records (URL, sha256 or locator per row), no model.
stored files, documents and chunks, and counts over them
dip.gov.bd: stored files
283
dip.gov.bd: PDF files
282
dip.gov.bd: first upload folder
2024/12
dip.gov.bd: last upload folder
2026/7
dip.gov.bd: files by type
Type
Files
Bytes
pdf
Files: 282
Bytes: 166,244,160
doc
Files: 1
Bytes: 1,558,528
dip.gov.bd: files by upload folder, as printed
Upload folder
Files
2024/12
Files: 266
2026/0
Files: 5
2026/1
Files: 1
dip.gov.bd: text-layer checks
Verdict
PDFs
No text
PDFs: 2
dip.gov.bd: stored files, first 50 of 283
Manifest line
Type
Bytes
Upload folder
23,243
Type: pdf
Bytes: 55,541
Upload folder: 2024/12
23,246
Type:
Where these figures come from
The source collections
Source
Publisher
Unit
Caveat
Stored files from government portals
Publisher: Uploading offices of the national portal (stored copies)
Unit: one row per stored file: manifest line, URL, sha256 at fetch, bytes, office, upload folder, file type; source file is relative to the archive disk root
Caveat: upload folder is the object store's <year>/<number> folder exactly as it appears in the URL, not the document's own date; under 2026 the number runs 0 to 8, so it may be a zero-based month, which is not verified. The issuing body is the office-<slug> URL segment; its portal host is the slug with hyphens read as dots. Body and Place links are exact-domain matches only. sha256 verified is set only for re-hashed files (the random sample and the pilot); the rest carry the harvest's own sha256.
Not held
Document and chunk text: Never stored in the lake or served; chunks are located by page range and pinned by the sha256 of their extracted text so a reader re-extracts them.
Documents about a person: CVs, personal data sheets, rosters and beneficiary lists are screened out of the pilot; their printed dates and memo lines would describe individuals.
Phone numbers: Counted per chunk and document at the build (phones_detected), never stored.
A2 oracle_wave spec values: LLM-derived; used only to order pilot candidates, never served.
2026/3
Files: 2
2026/4
Files: 1
2026/5
Files: 5
2026/6
Files: 1
2026/7
Files: 2
pdf
Bytes: 102,141
Upload folder: 2024/12
23,249
Type: pdf
Bytes: 62,964
Upload folder: 2024/12
23,250
Type: pdf
Bytes: 95,084
Upload folder: 2024/12
23,251
Type: pdf
Bytes: 818,438
Upload folder: 2024/12
23,252
Type: pdf
Bytes: 284,556
Upload folder: 2024/12
23,253
Type: pdf
Bytes: 58,047
Upload folder: 2024/12
23,254
Type: pdf
Bytes: 375,795
Upload folder: 2024/12
23,255
Type: pdf
Bytes: 237,503
Upload folder: 2024/12
23,256
Type: pdf
Bytes: 106,015
Upload folder: 2024/12
23,258
Type: pdf
Bytes: 659,474
Upload folder: 2024/12
23,259
Type: pdf
Bytes: 132,419
Upload folder: 2024/12
23,260
Type: pdf
Bytes: 610,078
Upload folder: 2024/12
23,261
Type: pdf
Bytes: 417,669
Upload folder: 2024/12
23,262
Type: pdf
Bytes: 382,188
Upload folder: 2024/12
23,263
Type: pdf
Bytes: 632,367
Upload folder: 2024/12
23,264
Type: pdf
Bytes: 46,773
Upload folder: 2024/12
23,265
Type: pdf
Bytes: 58,590
Upload folder: 2024/12
23,266
Type: pdf
Bytes: 695,394
Upload folder: 2024/12
23,268
Type: pdf
Bytes: 1,054,117
Upload folder: 2024/12
23,269
Type: pdf
Bytes: 492,556
Upload folder: 2024/12
23,270
Type: pdf
Bytes: 763,140
Upload folder: 2024/12
23,271
Type: pdf
Bytes: 946,405
Upload folder: 2024/12
23,272
Type: pdf
Bytes: 320,226
Upload folder: 2024/12
23,273
Type: pdf
Bytes: 405,072
Upload folder: 2024/12
23,274
Type: pdf
Bytes: 576,046
Upload folder: 2024/12
23,275
Type: pdf
Bytes: 50,259
Upload folder: 2024/12
23,276
Type: pdf
Bytes: 4,357,188
Upload folder: 2024/12
23,277
Type: pdf
Bytes: 89,172
Upload folder: 2024/12
23,278
Type: pdf
Bytes: 906,418
Upload folder: 2024/12
23,279
Type: pdf
Bytes: 687,320
Upload folder: 2024/12
23,280
Type: pdf
Bytes: 476,365
Upload folder: 2024/12
23,281
Type: pdf
Bytes: 748,057
Upload folder: 2024/12
23,282
Type: pdf
Bytes: 84,816
Upload folder: 2024/12
23,283
Type: pdf
Bytes: 102,783
Upload folder: 2024/12
23,284
Type: pdf
Bytes: 281,846
Upload folder: 2024/12
23,285
Type: pdf
Bytes: 302,693
Upload folder: 2024/12
23,286
Type: pdf
Bytes: 459,537
Upload folder: 2024/12
23,288
Type: pdf
Bytes: 63,145
Upload folder: 2024/12
23,289
Type: pdf
Bytes: 593,203
Upload folder: 2024/12
23,290
Type: pdf
Bytes: 427,817
Upload folder: 2024/12
23,291
Type: pdf
Bytes: 744,366
Upload folder: 2024/12
23,292
Type: pdf
Bytes: 781,131
Upload folder: 2024/12
23,293
Type: pdf
Bytes: 56,229
Upload folder: 2024/12
23,294
Type: pdf
Bytes: 758,116
Upload folder: 2024/12
23,295
Type: pdf
Bytes: 260,732
Upload folder: 2024/12
23,296
Type: pdf
Bytes: 688,787
Upload folder: 2024/12
23,297
Type: pdf
Bytes: 330,694
Upload folder: 2024/12
23,298
Type: pdf
Bytes: 516,701
Upload folder: 2024/12
23,299
Type: pdf
Bytes: 795,646
Upload folder: 2024/12
Not held: Text layer, Pages, Re-hash verified.
Per-issuing-body manifest datasets
Publisher: Built from the rows above by the inventory pipeline
Unit: one row per uploading office, with its partition file and sha256
Caveat: Each body's inventory partition is the resumable unit of the pipeline; a rerun rewrites only partitions whose rows changed.
200-chunk pilot: documents and chunks with printed fields
Publisher: each document's stored PDF (PyMuPDF text layer)
Unit: one row per pilot document (fields with page and line) and per chunk (page range, counts, text sha256)
Caveat: Pilot documents were chosen in the priority order of the A2 oracle wave specs (LLM extractions, used as pointers only; no spec value is stored or served), one document per body, text-layer PDFs fully chunked in at most 4 chunks. Documents about a person (CVs, data sheets, rosters, beneficiary lists, or two or more mobile numbers on pages 1-2) are screened out before chunking. Kind keywords match only Unicode Bangla in logical order or English; many portal PDFs extract Bangla in visual order or legacy font encodings, so an absent kind is not evidence of none.
Pipeline run log (measured)
Publisher: Measured pipeline runs on a 16-core machine
Unit: one row per stage run: items, bytes, seconds, workers
Caveat: Runs over files a previous run had just read hit the page cache and overstate the rate; the projection uses the cold runs named in its basis.