Basis: sourced records (URL, sha256 or locator per row), no model.
stored files, documents and chunks, and counts over them
dot.gov.bd: stored files
1,278
dot.gov.bd: PDF files
1,254
dot.gov.bd: first upload folder
2024/12
dot.gov.bd: last upload folder
2026/8
dot.gov.bd: files by type
Type
Files
Bytes
pdf
Files: 1,254
Bytes: 535,351,927
docx
Files: 23
Bytes: 949,591
dot.gov.bd: files by upload folder, as printed
Upload folder
Files
2024/12
Files: 1,160
2026/0
Files: 29
2026/1
Files: 7
dot.gov.bd: text-layer checks
Verdict
PDFs
Text
PDFs: 45
Legacy bangla
PDFs: 1
dot.gov.bd: stored files, first 50 of 1,278
Manifest line
Type
Bytes
Upload folder
Text layer
Pages
25,701
Type: pdf
Bytes: 129,539
Upload folder: 2024/12
Text layer:
dot.gov.bd: pilot documents and their printed fields
Upload folder
Pages
Chunks
Printed domain
Page
Line
Printed date
Page
Line
Printed memo
Page
Line
2024/12
dot.gov.bd: pilot chunks
First page
Last page
Characters
Lines
Numeric tokens
Bangla share
1
Last page: 2
Characters: 2,679
Lines: 51
Where these figures come from
The source collections
Source
Publisher
Unit
Caveat
Stored files from government portals
Publisher: Uploading offices of the national portal (stored copies)
Unit: one row per stored file: manifest line, URL, sha256 at fetch, bytes, office, upload folder, file type; source file is relative to the archive disk root
Caveat: upload folder is the object store's <year>/<number> folder exactly as it appears in the URL, not the document's own date; under 2026 the number runs 0 to 8, so it may be a zero-based month, which is not verified. The issuing body is the office-<slug> URL segment; its portal host is the slug with hyphens read as dots. Body and Place links are exact-domain matches only. sha256 verified is set only for re-hashed files (the random sample and the pilot); the rest carry the harvest's own sha256.
Not held
Document and chunk text: Never stored in the lake or served; chunks are located by page range and pinned by the sha256 of their extracted text so a reader re-extracts them.
Documents about a person: CVs, personal data sheets, rosters and beneficiary lists are screened out of the pilot; their printed dates and memo lines would describe individuals.
Phone numbers: Counted per chunk and document at the build (phones_detected), never stored.
A2 oracle_wave spec values: LLM-derived; used only to order pilot candidates, never served.
doc
Files: 1
Bytes: 4,031,488
2026/2
Files: 3
2026/3
Files: 10
2026/4
Files: 7
2026/5
Files: 23
2026/6
Files: 8
2026/7
Files: 11
2026/8
Files: 20
not available
Pages: not available
25,704
Type: pdf
Bytes: 110,484
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,706
Type: pdf
Bytes: 115,189
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,707
Type: pdf
Bytes: 127,088
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,708
Type: pdf
Bytes: 128,145
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,710
Type: pdf
Bytes: 133,445
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,711
Type: pdf
Bytes: 282,770
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,713
Type: pdf
Bytes: 61,624
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,714
Type: pdf
Bytes: 126,295
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,715
Type: pdf
Bytes: 144,216
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,716
Type: pdf
Bytes: 100,448
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,717
Type: pdf
Bytes: 5,975,056
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,718
Type: docx
Bytes: 40,242
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,719
Type: pdf
Bytes: 140,108
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,720
Type: pdf
Bytes: 75,425
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,721
Type: pdf
Bytes: 94,563
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,722
Type: pdf
Bytes: 7,261,104
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,723
Type: pdf
Bytes: 108,132
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,725
Type: pdf
Bytes: 144,108
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,726
Type: pdf
Bytes: 114,872
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,727
Type: pdf
Bytes: 4,959,163
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,729
Type: docx
Bytes: 41,158
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,730
Type: pdf
Bytes: 140,976
Upload folder: 2024/12
Text layer: Text
Pages: 2
25,731
Type: pdf
Bytes: 138,191
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,732
Type: pdf
Bytes: 123,470
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,733
Type: pdf
Bytes: 99,901
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,734
Type: pdf
Bytes: 96,695
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,735
Type: pdf
Bytes: 136,979
Upload folder: 2024/12
Text layer: Text
Pages: 2
25,736
Type: pdf
Bytes: 143,798
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,738
Type: pdf
Bytes: 105,810
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,739
Type: pdf
Bytes: 98,296
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,740
Type: pdf
Bytes: 218,412
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,741
Type: pdf
Bytes: 124,931
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,742
Type: pdf
Bytes: 783,865
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,743
Type: pdf
Bytes: 100,946
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,744
Type: docx
Bytes: 41,867
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,745
Type: pdf
Bytes: 107,842
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,746
Type: pdf
Bytes: 111,205
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,747
Type: pdf
Bytes: 369,632
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,748
Type: pdf
Bytes: 2,219,934
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,749
Type: pdf
Bytes: 117,067
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,750
Type: pdf
Bytes: 124,208
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,751
Type: pdf
Bytes: 32,785
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,752
Type: pdf
Bytes: 142,768
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,753
Type: pdf
Bytes: 135,463
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,754
Type: pdf
Bytes: 123,537
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,755
Type: pdf
Bytes: 132,698
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,756
Type: pdf
Bytes: 1,868,734
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,758
Type: pdf
Bytes: 139,571
Upload folder: 2024/12
Text layer: not available
Pages: not available
25,759
Type: pdf
Bytes: 83,952
Upload folder: 2024/12
Text layer: not available
Pages: not available
Not held: Re-hash verified.
Pages:
2
Chunks: 1
Printed domain: www.dot.gov.bd
Page: 1
Line: 6
Printed date: ০৬/০৪/২০২৫
Page: 1
Line: 13
Printed memo: ২৪.০২.০০০০.০০০.০০৩.১৪.০০০১.২৫.২৩
Page: 1
Line: 7
Not held: Printed kind, Page, Line.
Numeric tokens:
71
Bangla share: 89.89%
Per-issuing-body manifest datasets
Publisher: Built from the rows above by the inventory pipeline
Unit: one row per uploading office, with its partition file and sha256
Caveat: Each body's inventory partition is the resumable unit of the pipeline; a rerun rewrites only partitions whose rows changed.
200-chunk pilot: documents and chunks with printed fields
Publisher: each document's stored PDF (PyMuPDF text layer)
Unit: one row per pilot document (fields with page and line) and per chunk (page range, counts, text sha256)
Caveat: Pilot documents were chosen in the priority order of the A2 oracle wave specs (LLM extractions, used as pointers only; no spec value is stored or served), one document per body, text-layer PDFs fully chunked in at most 4 chunks. Documents about a person (CVs, data sheets, rosters, beneficiary lists, or two or more mobile numbers on pages 1-2) are screened out before chunking. Kind keywords match only Unicode Bangla in logical order or English; many portal PDFs extract Bangla in visual order or legacy font encodings, so an absent kind is not evidence of none.
Pipeline run log (measured)
Publisher: Measured pipeline runs on a 16-core machine
Unit: one row per stage run: items, bytes, seconds, workers
Caveat: Runs over files a previous run had just read hit the page cache and overstate the rate; the projection uses the cold runs named in its basis.