
Research
/Security News
Toptal’s GitHub Organization Hijacked: 10 Malicious Packages Published
Threat actors hijacked Toptal’s GitHub org, publishing npm packages with malicious payloads that steal tokens and attempt to wipe victim systems.
Notice: The cmdc
library has been renamed to covidcountydata
Please use that package instead of this one. See the covidcountydata package on GitHub for more information
This package will remain active for historical users of cmdc, but we strongly encourage all users to upgrade to the new package to continue receiving new features and bug fixes.
cmdc
is a Python client for accessing the COVID Modeling Data Collaborative database
Links:
The COVID Modeling Data Collaborative (CMDC) is a project funded by Schmidt Futures and seeks to simplify the data ingestion process for researchers and policy makers who are working to enact and understand COVID-19 related policies. We accomplish this goal in several ways:
More information about our project and what data is collected can be found on our website.
We are always looking to hear from both those who would like to help us build CMDC and those who would like use CMDC. Please reach out to us!
This package is available on the Python Package Index (pypi) and can be installed by
pip install cmdc
We will try to keep the broad list of datasets/topics on this page up-to-date, but, as we work to collect more data, it may fall behind. You can always find the available datasets in the client object by writing:
import cmdc
c = cmdc.Client()
print(c.datasets)
You can also find documentation for these datasets online. This documentation will include more detailed information about the variables included in a particular dataset, where the data comes from, and any caveats that you should be aware of. We encourage you to read about the data you use to ensure that it is appropriate for your intended analysis -- A failure to understand the data you work with guarantees the failure of any subsequent analysis.
The currently available datasets include:
mobility_devices
: A dataset produced by researchers at Berkeley, U Chicago, U Penn, and Yale on within county mobilitymobility_locations
: A dataset produced by researchers at Berkeley, U Chicago, U Penn, and Yale on within state mobilitycovid
: This dataset includes information specific to the COVID pandemic including information like total cases, tests, and hospitalizations. It is based only on official sources and builds on the excellent work of COVID Atlas and the COVID Tracking Project. This dataset includes only the most recent observation for each variable. For a historical record of the available data as of a particular date, see the covid_historical
datasetcovid_historical
: Same as the covid table, but with an additional vintage
column that tracks the date the data was accessed.demographics
: A dataset that incorporates baseline information about the different U.S. geographies. Includes data such as total population, fraction of the population over 65, fraction of individuals who are uninsured, etc...economics
: This dataset includes information about the state of the economy in different geographic areas.All of the data in our database is indexed by one or more common "keys". These keys are:
vintage
: The date and time that the data was downloaded into our database. We collect this because of the rapidly eveolving nature of the data and it is important to have a record of when data was changed/corrected/updated.dt
: The date and time that an observation corresponds to. For series like COVID tests administered this may a daily frequency, but, for others like unemployment it may be a weekly or monthly frequency.fips
: The Federal Information Processing Standards number which is used to represent the state/county.meta_date
: For infrequently observed and slow moving data sets, such as demographics, we use the meta_date
column rather than dt
because we will associate the values from the meta_date
with many values of dt
.Whenever two series with common keys are loaded together, they will be merged on their common keys.
The CMDC data is publicly available and free of charge. We intend to keep it that way.
We do have an API key system for a few reasons:
The CMDC library can automatically handle API keys for you.
If opt in to using an API key, please run the register
method on the client as shown below:
c = Client()
c.register()
You will be prompted for your email address. After entering a valid email address we will issue an API key, store it on your machine, and automatically apply it to all future requests to our servers.
If at any time you would like to remove your API key, please delete the file ~/.cmdc/apikey
We provide a few simple examples here in the README, but you can find additional examples in the examples
folder.
The example below loads all within county mobility data
c = cmdc.Client()
c.mobility_devices()
df = c.fetch()
The example below loads just demographic information for Travis County in Texas.
Notice that we can select a particular geography by specifying the fips code. We can do similar things for any of they keys listed previously.
c = Client()
c.demographics(fips=48453)
df = c.fetch()
The example below loads just demographic information for all counties in Texas.
Notice that we can select a particular geography by specifying the fips code. We can do similar things for any of they keys listed previously.
c = Client()
c.demographics(state=48)
df = c.fetch()
The example below loads covid and demographic data and showcases how to chain calls to multiple datasets together. It will automatically merge and return these datasets.
Note that applying a filter to any of the datasets (in this case fips=6037
) will apply it to all datasets.
c = Client()
(
c
.covid(fips=6037)
.demographics()
)
df = c.fetch()
The example below
The example below loads data from three datasets for a particular FIPS code, using a particular date of demographics, and selects certain variables from the datasets.
c = Client()
(
c
.economics(meta_date="2018-01-01", variable="GDP_All industry total")
.covid(fips=6037)
.demographics(variable="Total population")
)
df = c.fetch()
There are more examples in the cmdc/examples.py
file. We encourage you to explore them and to reach out if you have questions!
FAQs
Python client for accessing the COVID Modeling Data Collaborative database
We found that cmdc demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Research
/Security News
Threat actors hijacked Toptal’s GitHub org, publishing npm packages with malicious payloads that steal tokens and attempt to wipe victim systems.
Research
/Security News
Socket researchers investigate 4 malicious npm and PyPI packages with 56,000+ downloads that install surveillance malware.
Security News
The ongoing npm phishing campaign escalates as attackers hijack the popular 'is' package, embedding malware in multiple versions.