Basis: sourced records (URL, sha256 or locator per row), no model.
stored files, documents and chunks, and counts over them
bscl.gov.bd: stored files
281
bscl.gov.bd: PDF files
279
bscl.gov.bd: first upload folder
2024/12
bscl.gov.bd: last upload folder
2026/8
bscl.gov.bd: files by type
Type
Files
Bytes
pdf
Files: 279
Bytes: 277,825,604
docx
Files: 2
Bytes: 247,440
bscl.gov.bd: files by upload folder, as printed
Upload folder
Files
2024/12
Files: 224
2026/0
Files: 4
2026/1
Files: 4
bscl.gov.bd: text-layer checks
Verdict
PDFs
Text
PDFs: 13
bscl.gov.bd: stored files, first 50 of 281
Manifest line
Type
Bytes
Upload folder
Text layer
Pages
Re-hash verified
12,004
Type: pdf
Bytes: 176,598
Upload folder: 2024/12
bscl.gov.bd: pilot documents and their printed fields
Upload folder
Pages
Chunks
Printed kind
Page
Line
Printed date
Page
Line
Printed memo
Page
Line
2024/12
bscl.gov.bd: pilot chunks
First page
Last page
Characters
Lines
Numeric tokens
Bangla share
1
Last page: 1
Characters: 2,219
Lines: 100
Where these figures come from
The source collections
Source
Publisher
Unit
Caveat
Stored files from government portals
Publisher: Uploading offices of the national portal (stored copies)
Unit: one row per stored file: manifest line, URL, sha256 at fetch, bytes, office, upload folder, file type; source file is relative to the archive disk root
Caveat: upload folder is the object store's <year>/<number> folder exactly as it appears in the URL, not the document's own date; under 2026 the number runs 0 to 8, so it may be a zero-based month, which is not verified. The issuing body is the office-<slug> URL segment; its portal host is the slug with hyphens read as dots. Body and Place links are exact-domain matches only. sha256 verified is set only for re-hashed files (the random sample and the pilot); the rest carry the harvest's own sha256.
Not held
Document and chunk text: Never stored in the lake or served; chunks are located by page range and pinned by the sha256 of their extracted text so a reader re-extracts them.
Documents about a person: CVs, personal data sheets, rosters and beneficiary lists are screened out of the pilot; their printed dates and memo lines would describe individuals.
Phone numbers: Counted per chunk and document at the build (phones_detected), never stored.
A2 oracle_wave spec values: LLM-derived; used only to order pilot candidates, never served.
2026/2
Files: 2
2026/3
Files: 13
2026/4
Files: 8
2026/5
Files: 5
2026/6
Files: 11
2026/7
Files: 8
2026/8
Files: 2
Text layer:
not available
Pages: not available
Re-hash verified: not available
12,006
Type: pdf
Bytes: 86,001
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,007
Type: pdf
Bytes: 490,332
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,009
Type: pdf
Bytes: 460,480
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,011
Type: pdf
Bytes: 213,371
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,012
Type: pdf
Bytes: 180,171
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,015
Type: pdf
Bytes: 173,529
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,017
Type: pdf
Bytes: 188,518
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,018
Type: docx
Bytes: 112,920
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,019
Type: pdf
Bytes: 3,496,227
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,020
Type: pdf
Bytes: 199,645
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,021
Type: pdf
Bytes: 193,175
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,022
Type: pdf
Bytes: 243,524
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,023
Type: pdf
Bytes: 415,585
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,024
Type: pdf
Bytes: 108,569
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,025
Type: pdf
Bytes: 89,885
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,026
Type: pdf
Bytes: 279,316
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,027
Type: pdf
Bytes: 133,399
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,028
Type: pdf
Bytes: 370,564
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,029
Type: pdf
Bytes: 194,015
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,030
Type: pdf
Bytes: 562,185
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,031
Type: pdf
Bytes: 5,520,367
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,032
Type: pdf
Bytes: 185,715
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,033
Type: pdf
Bytes: 443,774
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,034
Type: pdf
Bytes: 201,914
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,035
Type: pdf
Bytes: 500,204
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,036
Type: pdf
Bytes: 174,171
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,037
Type: pdf
Bytes: 85,014
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,038
Type: pdf
Bytes: 263,029
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,039
Type: pdf
Bytes: 179,600
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,040
Type: pdf
Bytes: 493,488
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,041
Type: pdf
Bytes: 88,582
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,042
Type: pdf
Bytes: 104,970
Upload folder: 2024/12
Text layer: Text
Pages: 2
Re-hash verified: yes
12,043
Type: pdf
Bytes: 143,908
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,044
Type: pdf
Bytes: 129,031
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,045
Type: pdf
Bytes: 824,289
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,046
Type: pdf
Bytes: 121,184
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,047
Type: pdf
Bytes: 218,183
Upload folder: 2024/12
Text layer: Text
Pages: 1
Re-hash verified: not available
12,048
Type: pdf
Bytes: 294,437
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,049
Type: pdf
Bytes: 348,733
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,050
Type: pdf
Bytes: 102,408
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,051
Type: pdf
Bytes: 537,126
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,052
Type: pdf
Bytes: 143,156
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,053
Type: pdf
Bytes: 343,909
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,054
Type: pdf
Bytes: 2,289,014
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,055
Type: pdf
Bytes: 198,385
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,056
Type: pdf
Bytes: 316,305
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,057
Type: pdf
Bytes: 458,955
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,058
Type: pdf
Bytes: 4,201,186
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
12,059
Type: pdf
Bytes: 1,073,715
Upload folder: 2024/12
Text layer: not available
Pages: not available
Re-hash verified: not available
Pages:
1
Chunks: 1
Printed kind: Tender
Page: 1
Line: 23
Printed date: 24/04/2023
Page: 1
Line: 20
Printed memo: 14.39.0000.012.07.002.23.188
Page: 1
Line: 18
Not held: Printed domain, Page, Line.
Numeric tokens:
37
Bangla share: 0%
Per-issuing-body manifest datasets
Publisher: Built from the rows above by the inventory pipeline
Unit: one row per uploading office, with its partition file and sha256
Caveat: Each body's inventory partition is the resumable unit of the pipeline; a rerun rewrites only partitions whose rows changed.
200-chunk pilot: documents and chunks with printed fields
Publisher: each document's stored PDF (PyMuPDF text layer)
Unit: one row per pilot document (fields with page and line) and per chunk (page range, counts, text sha256)
Caveat: Pilot documents were chosen in the priority order of the A2 oracle wave specs (LLM extractions, used as pointers only; no spec value is stored or served), one document per body, text-layer PDFs fully chunked in at most 4 chunks. Documents about a person (CVs, data sheets, rosters, beneficiary lists, or two or more mobile numbers on pages 1-2) are screened out before chunking. Kind keywords match only Unicode Bangla in logical order or English; many portal PDFs extract Bangla in visual order or legacy font encodings, so an absent kind is not evidence of none.
Pipeline run log (measured)
Publisher: Measured pipeline runs on a 16-core machine
Unit: one row per stage run: items, bytes, seconds, workers
Caveat: Runs over files a previous run had just read hit the page cache and overstate the rate; the projection uses the cold runs named in its basis.