Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add functionality to fetch and save PubMed records by year
This commit introduces significant enhancements to the PubMedDownloader class, enabling the automated fetching of PubMed records by topic and year using the NCBI E-utilities API. Each set of records fetched for a specific year is now saved in a dedicated text file formatted in MEDLINE style, facilitating easier access and organization of the data. Key Changes: - Added file saving functionality that organizes records into files named by topic and year. - Implemented error handling with retry logic and exponential backoff to manage network and API errors more robustly. - Configured the fetch function to retrieve records in MEDLINE format, ensuring that the data is structured according to PubMed's bibliographic standards. The records are stored in the './results/baseline_doc' directory, with each file representing a specific year's data on the chosen topic. This update is crucial for researchers needing structured and easily accessible bibliographic information from PubMed.
- Loading branch information