Dataset information
Available languages
English
Keywords
archivage-du-web, philosophie, lorraine, jeux-olympiques, droit, sciences, economie, administration, culture, languedoc-roussillon, provence-alpes-cote-dazur, la-reunion, arts-du-spectacle, audiovisuel, litterature, alsace, arts, estampes, histoire, internet, politique, actualites, bibliotheque-nationale-de-france, recherche-bibliographique, depot-legal, musique
Dataset description
As part of its heritage mission of [legal deposit of the internet] (https://www.bnf.fr/en/centre-d-aide/depot-legal-des-sites-web-mode-demploi), the Bibliothèque nationale de France regularly collects a sample of the French web, made up of large collections (annual and non-selective) and targeted collections. The latter group together two types of collection:
* project collections, often carried out in cooperation with partners (libraries, research centres, associations), characterised by their greater sensitivity to current events and by their transversality or thematic specificity;
* "current" collections, for reference sites on a given disciplinary field, carried out since 2011 at varying frequencies (from "once a week" to "once a year"). In partnership with the BnF, five libraries (Bibliothèque nationale et universitaire de Strasbourg, Médiathèque centrale d'Agglomération Emile Zola de Montpellier, Bibliothèque municipale de Nancy, Bibliothèque de l'Alcazar à Marseille and Bibliothèque départementale de la Réunion) have a regular collection, respectively on the Alsatics, Languedoc-Roussillon, Lorraine, Provence-Alpes-Côte d'Azur and Réunion.
All archived sites are [available](https://www.bnf.fr/en/archives-de-linternet) by researchers in [the reading rooms of the BnF and the libraries of legal deposit printer](https://umap.openstreetmap.fr/en/map/or-consult-les-archives-de-linternet-de-la-bnf _73737#6/46.362/3.450).
For each day-to-day collection and/or project, nine CVS tables are made available: the list of URLs (of sites, blogs, social media accounts) collected from 2011 to 2016 and the lists of those collected in 2017, 2018, 2019, 2020, 2021, 2022, 2023 and 2024. These csv tables are grouped into 23 compressed files. Each file contains the csv tables of a thematic current collection and the csv of the project collections directly related to this current collection, as well as a text file describing the collections. Each URL address is accompanied by description elements (theme, keywords, additional descriptive information) and technical parameters on its collection (frequency, URL history). The files are encoded in UTF-8. For 2024, the files are also available in .xls.  format;
In total, this dataset consists of 249 csv tables and 31 xls tables containing more than 110,000 URL addresses collected since 2011.
The BnF also carries out [electoral web collections] (https://www.data.gouv.fr/en/datasets/collectes-du-web-electoral-par-la-bnf/).
European data infrastructure with broad catalog discovery, free evaluation access and production-grade API options.
190K+
indexed dataset pages
32
countries and EU institutions
Free API quota
for evaluation and prototypes
SLA
history and push on production APIs