This project aims to deepen the understanding of information capture from the Google Play Developer Reporting Api.
Here are some objectives that will be met during the course of development.
- Create a functional Google Api authentication method;
- Create a replicable standard contract model for obtaining reports;
- Generate JSON files from query responses;
- Transform JSON files into normalized information files;
- Implement a repetition loop to increment reports with a size greater than one thousand objects;
- Use environments parameters to period to get raw data;
- Create a playground MVP based on pandas;
- Build example datasets from the local folder;-
- Create an example dashboard;
- Use environment variables instead of a JSON credentials file;
- Move params to environment file;
- Create folder raw_data for the different apps;
- Create folder datasets for the different apps;
- Create default methods to log;
- Merge data frames;
- Refactor code;
- Discovery about the return of the Error Report query;
- Refactor structure responsible for controlling reports;
- Fix raw_data folders name;
- Create exception when page failed;
- Implement retry to ssl timeout error or verify if pageToken is resilient;
- Fix period information for reports;
- Create methods to transform/load by metrics type and reports type;
- Verify existant filters. Ex.: If dataset don't have a date value;
- Create friendly documentation;
- Get massive data;
- Fix without null dates on merge datasets on Playground;
- Create workload for ingest data on BigQuery;
- Create module to increment data;
- Fix datetime from logs;
- Recognize fresh data;
- Disable ErrorCount until you understand its real use
- Separate reports dictionary in json file
- Add userPerceivedAnrRate metric to AnrRateMetricSet