vars_retrieved_20200626.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "(C) Crown Copyright, Met Office. All rights reserved."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## vars_retrieved_20200626.ipynb\n",
    "\n",
    "This notebook calculates the number of variables that have been requested for retrieval from tape to disk at JASMIN by the PRIMAVERA project using data from the DMT. The number is the number of times that this variable has been requested. A value of 1 means that this variable has been requested once from a single model for a single experiment. 7 could mean that this variable had been requested from all models for a single experiment, or that the same variable from one model and experiment has been requested by seven different people. The name is in the form \"var-name_table-name\" and the table name includes the frequency of that variable. The variable's standard name is included in the third column.\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Last run 2020-06-29 09:17:25.696678\n"
     ]
    }
   ],
   "source": [
    "import datetime\n",
    "print(f'Last run {datetime.datetime.utcnow()}')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "from collections import OrderedDict\n",
    "\n",
    "import django\n",
    "django.setup()\n",
    "from pdata_app.models import DataRequest, RetrievalRequest, VariableRequest"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "var_reqs = {}\n",
    "\n",
    "# Ignore retrievals by Jon as these were for publication rather than analysis\n",
    "for rr in RetrievalRequest.objects.exclude(requester__username='jseddon').order_by('id'):\n",
    "    for dr in rr.data_request.all():\n",
    "        if dr.variable_request not in var_reqs:\n",
    "            var_reqs[dr.variable_request] = 1\n",
    "        else:\n",
    "            var_reqs[dr.variable_request] += 1\n",
    "    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "var_reqs_ordered = OrderedDict(sorted(var_reqs.items(), key=lambda x: (x[0].frequency, x[0].table_name, x[0].cmor_name)))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Look at the variables requested for retrieval.\n",
    "\n",
    "The number is the number of times that this variable has been requested. A value of 1 means that this variable has been requested once from a single model for a single experiment. 7 could mean that this variable had been requested from all models for a single experiment, or that the same variable from one model and experiment has been requested by seven different people."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "pr_E1hr               28   precipitation_flux\n",
      "clt_Prim1hr            4   cloud_area_fraction_in_atmosphere_layer\n",
      "rsds_Prim1hr           8   surface_downwelling_shortwave_flux_in_air\n",
      "rsdsdiff_Prim1hr       2   surface_diffuse_downwelling_shortwave_flux_in_air\n",
      "tas_Prim1hr           18   air_temperature\n",
      "ua50m_Prim1hr          4   eastward_wind\n",
      "uas_Prim1hr           29   eastward_wind\n",
      "va50m_Prim1hr          4   northward_wind\n",
      "vas_Prim1hr           24   northward_wind\n",
      "clt_3hr                2   cloud_area_fraction\n",
      "hfls_3hr              43   surface_upward_latent_heat_flux\n",
      "hfss_3hr              34   surface_upward_sensible_heat_flux\n",
      "huss_3hr              48   specific_humidity\n",
      "mrro_3hr              22   runoff_flux\n",
      "mrsos_3hr              8   moisture_content_of_soil_layer\n",
      "pr_3hr               146   precipitation_flux\n",
      "prc_3hr               11   convective_precipitation_flux\n",
      "prsn_3hr               9   snowfall_flux\n",
      "ps_3hr                18   surface_air_pressure\n",
      "rlds_3hr              45   surface_downwelling_longwave_flux_in_air\n",
      "rldscs_3hr            30   surface_downwelling_longwave_flux_in_air_assuming_clear_sky\n",
      "rlus_3hr              38   surface_upwelling_longwave_flux_in_air\n",
      "rsds_3hr              15   surface_downwelling_shortwave_flux_in_air\n",
      "rsdscs_3hr             3   surface_downwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "rsus_3hr              33   surface_upwelling_shortwave_flux_in_air\n",
      "tas_3hr               13   air_temperature\n",
      "tslsi_3hr              1   surface_temperature\n",
      "tso_3hr                1   sea_surface_temperature\n",
      "uas_3hr               72   eastward_wind\n",
      "vas_3hr               70   northward_wind\n",
      "prw_E3hr              47   atmosphere_water_vapor_content\n",
      "psl_E3hr              27   air_pressure_at_sea_level\n",
      "rsdt_E3hr              2   toa_incoming_shortwave_flux\n",
      "hus7h_E3hrPt          24   specific_humidity\n",
      "psl_E3hrPt             8   air_pressure_at_sea_level\n",
      "ta7h_E3hrPt           29   air_temperature\n",
      "ua7h_E3hrPt           33   eastward_wind\n",
      "ua850_E3hrPt           1   eastward_wind\n",
      "va7h_E3hrPt           30   northward_wind\n",
      "va850_E3hrPt           1   northward_wind\n",
      "wap7h_E3hrPt           4   lagrangian_tendency_of_air_pressure\n",
      "sfcWind_Prim3hr       17   wind_speed\n",
      "sfcWindmax_Prim3hr     1   wind_speed\n",
      "ua100m_Prim3hrPt       3   eastward_wind\n",
      "ua50m_Prim3hrPt        1   eastward_wind\n",
      "va100m_Prim3hrPt       3   northward_wind\n",
      "va50m_Prim3hrPt        1   northward_wind\n",
      "zg7h_Prim3hrPt       111   geopotential_height\n",
      "tos_3hr                1   sea_surface_temperature\n",
      "psl_CF3hr              1   air_pressure_at_sea_level\n",
      "psl_6hrPlev           14   air_pressure_at_sea_level\n",
      "hus7h_6hrPlevPt       37   specific_humidity\n",
      "huss_6hrPlevPt        21   specific_humidity\n",
      "psl_6hrPlevPt        100   air_pressure_at_sea_level\n",
      "sfcWind_6hrPlevPt     38   wind_speed\n",
      "ta_6hrPlevPt           6   air_temperature\n",
      "ta7h_6hrPlevPt         6   air_temperature\n",
      "tas_6hrPlevPt          8   air_temperature\n",
      "ts_6hrPlevPt           1   surface_temperature\n",
      "ua_6hrPlevPt          67   eastward_wind\n",
      "ua7h_6hrPlevPt        52   eastward_wind\n",
      "uas_6hrPlevPt        110   eastward_wind\n",
      "va_6hrPlevPt          65   northward_wind\n",
      "va7h_6hrPlevPt        48   northward_wind\n",
      "vas_6hrPlevPt        112   northward_wind\n",
      "vortmean_6hrPlevPt     1   atmosphere_relative_vorticity\n",
      "zg27_6hrPlevPt        27   geopotential_height\n",
      "zg7h_6hrPlevPt       107   geopotential_height\n",
      "clt_Prim6hr            2   cloud_area_fraction\n",
      "hfls_Prim6hr           2   surface_upward_latent_heat_flux\n",
      "hus4_Prim6hr           2   specific_humidity\n",
      "pr_Prim6hr            96   precipitation_flux\n",
      "prc_Prim6hr           52   convective_precipitation_flux\n",
      "ps_Prim6hr            15   surface_air_pressure\n",
      "rsds_Prim6hr           1   surface_downwelling_shortwave_flux_in_air\n",
      "sfcWindmax_Prim6hr     1   wind_speed_of_gust\n",
      "ua4_Prim6hr            2   eastward_wind\n",
      "va4_Prim6hr            3   northward_wind\n",
      "wsgmax_Prim6hr         7   wind_speed_of_gust\n",
      "clt_Prim6hrPt          2   cloud_area_fraction\n",
      "ps_Prim6hrPt           4   surface_air_pressure\n",
      "ua1000_Prim6hrPt       1   eastward_wind\n",
      "clivi_CFday            6   atmosphere_cloud_ice_content\n",
      "clw_CFday              3   mass_fraction_of_cloud_liquid_water_in_air\n",
      "clwvi_CFday            8   atmosphere_cloud_condensed_water_content\n",
      "phalf_CFday            3   air_pressure\n",
      "ps_CFday              10   surface_air_pressure\n",
      "rlutcs_CFday           2   toa_outgoing_longwave_flux_assuming_clear_sky\n",
      "rsdt_CFday             5   toa_incoming_shortwave_flux\n",
      "rsut_CFday             5   toa_outgoing_shortwave_flux\n",
      "rsutcs_CFday           2   toa_outgoing_shortwave_flux_assuming_clear_sky\n",
      "ua_CFday               4   eastward_wind\n",
      "va_CFday               4   northward_wind\n",
      "tauu_Eday              4   surface_downward_eastward_stress\n",
      "ua_Eday                2   eastward_wind\n",
      "va_Eday                1   northward_wind\n",
      "zg_EdayZ               8   geopotential_height\n",
      "tos_Oday              22   sea_surface_temperature\n",
      "uo_PrimOday            1   sea_water_x_velocity\n",
      "vo_PrimOday            2   sea_water_y_velocity\n",
      "zos_PrimOday           6   sea_surface_height_above_geoid\n",
      "evspsbl_Primday        9   water_evaporation_flux\n",
      "hus10_Primday          1   specific_humidity\n",
      "ta23_Primday           8   air_temperature\n",
      "ts_Primday            46   surface_temperature\n",
      "ua10_Primday           1   eastward_wind\n",
      "ua23_Primday           9   eastward_wind\n",
      "va10_Primday           1   northward_wind\n",
      "va23_Primday           8   northward_wind\n",
      "zg10_Primday          14   geopotential_height\n",
      "zg23_Primday         121   geopotential_height\n",
      "ua_PrimdayPt           2   eastward_wind\n",
      "siconc_SIday           5   sea_ice_area_fraction\n",
      "siu_SIday             17   sea_ice_x_velocity\n",
      "siv_SIday             18   sea_ice_y_velocity\n",
      "clt_day               18   cloud_area_fraction\n",
      "hfls_day              31   surface_upward_latent_heat_flux\n",
      "hfss_day              19   surface_upward_sensible_heat_flux\n",
      "hus_day               61   specific_humidity\n",
      "huss_day              25   specific_humidity\n",
      "mrro_day              26   runoff_flux\n",
      "mrsos_day             18   moisture_content_of_soil_layer\n",
      "pr_day               367   precipitation_flux\n",
      "psl_day               72   air_pressure_at_sea_level\n",
      "rlds_day              15   surface_downwelling_longwave_flux_in_air\n",
      "rlut_day              24   toa_outgoing_longwave_flux\n",
      "sfcWind_day           31   wind_speed\n",
      "sfcWindmax_day        62   wind_speed\n",
      "snw_day                4   surface_snow_amount\n",
      "ta_day                85   air_temperature\n",
      "tas_day               74   air_temperature\n",
      "tasmax_day           152   air_temperature\n",
      "tasmin_day            64   air_temperature\n",
      "ua_day               194   eastward_wind\n",
      "uas_day               81   eastward_wind\n",
      "va_day               161   northward_wind\n",
      "vas_day               84   northward_wind\n",
      "wap_day               18   lagrangian_tendency_of_air_pressure\n",
      "zg_day               544   geopotential_height\n",
      "sftlf_fx               1   land_area_fraction\n",
      "cl_Amon               20   cloud_area_fraction_in_atmosphere_layer\n",
      "cli_Amon               4   mass_fraction_of_cloud_ice_in_air\n",
      "clt_Amon             314   cloud_area_fraction\n",
      "clw_Amon               4   mass_fraction_of_cloud_liquid_water_in_air\n",
      "evspsbl_Amon         329   water_evaporation_flux\n",
      "hfls_Amon            236   surface_upward_latent_heat_flux\n",
      "hfss_Amon            234   surface_upward_sensible_heat_flux\n",
      "hur_Amon              34   relative_humidity\n",
      "hurs_Amon              3   relative_humidity\n",
      "hus_Amon             333   specific_humidity\n",
      "huss_Amon            323   specific_humidity\n",
      "pfull_Amon             6   air_pressure\n",
      "phalf_Amon             5   air_pressure\n",
      "pr_Amon              1261   precipitation_flux\n",
      "prc_Amon              68   convective_precipitation_flux\n",
      "prsn_Amon             32   snowfall_flux\n",
      "prw_Amon              87   atmosphere_water_vapor_content\n",
      "ps_Amon              322   surface_air_pressure\n",
      "psl_Amon             828   air_pressure_at_sea_level\n",
      "rlds_Amon            202   surface_downwelling_longwave_flux_in_air\n",
      "rldscs_Amon           47   surface_downwelling_longwave_flux_in_air_assuming_clear_sky\n",
      "rlus_Amon            131   surface_upwelling_longwave_flux_in_air\n",
      "rlut_Amon             83   toa_outgoing_longwave_flux\n",
      "rlutcs_Amon           42   toa_outgoing_longwave_flux_assuming_clear_sky\n",
      "rsds_Amon            178   surface_downwelling_shortwave_flux_in_air\n",
      "rsdscs_Amon           45   surface_downwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "rsdt_Amon             82   toa_incoming_shortwave_flux\n",
      "rsus_Amon            172   surface_upwelling_shortwave_flux_in_air\n",
      "rsuscs_Amon           33   surface_upwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "rsut_Amon             88   toa_outgoing_shortwave_flux\n",
      "rsutcs_Amon           43   toa_outgoing_shortwave_flux_assuming_clear_sky\n",
      "sfcWind_Amon           3   wind_speed\n",
      "ta_Amon              354   air_temperature\n",
      "tas_Amon             692   air_temperature\n",
      "tasmax_Amon           25   air_temperature\n",
      "tasmin_Amon           23   air_temperature\n",
      "tauu_Amon             26   surface_downward_eastward_stress\n",
      "tauv_Amon             26   surface_downward_northward_stress\n",
      "ts_Amon              834   surface_temperature\n",
      "ua_Amon              513   eastward_wind\n",
      "uas_Amon              29   eastward_wind\n",
      "va_Amon              417   northward_wind\n",
      "vas_Amon              32   northward_wind\n",
      "wap_Amon             144   lagrangian_tendency_of_air_pressure\n",
      "zg_Amon              361   geopotential_height\n",
      "hur_CFmon              1   relative_humidity\n",
      "hus_CFmon              1   specific_humidity\n",
      "rld_CFmon              1   downwelling_longwave_flux_in_air\n",
      "rldcs_CFmon            1   downwelling_longwave_flux_in_air_assuming_clear_sky\n",
      "rlu_CFmon              1   upwelling_longwave_flux_in_air\n",
      "rlucs_CFmon            4   upwelling_longwave_flux_in_air_assuming_clear_sky\n",
      "rsd_CFmon              1   downwelling_shortwave_flux_in_air\n",
      "rsdcs_CFmon            1   downwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "rsu_CFmon              1   upwelling_shortwave_flux_in_air\n",
      "rsucs_CFmon            1   upwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "ta_CFmon               1   air_temperature\n",
      "uqint_Emon             7   integral_of_product_of_eastward_wind_and_specific_humidity_wrt_height\n",
      "vqint_Emon             7   integral_of_product_of_northward_wind_and_specific_humidity_wrt_height\n",
      "epfz_EmonZ            28   upward_eliassen_palm_flux_in_air\n",
      "snc_LImon              5   surface_snow_area_fraction\n",
      "snd_LImon             34   surface_snow_thickness\n",
      "snw_LImon              7   surface_snow_amount\n",
      "tsn_LImon              1   temperature_in_surface_snow\n",
      "mrlsl_Lmon            34   moisture_content_of_soil_layer\n",
      "mrro_Lmon             38   runoff_flux\n",
      "mrros_Lmon             5   surface_runoff_flux\n",
      "mrso_Lmon             72   soil_moisture_content\n",
      "mrsos_Lmon             7   moisture_content_of_soil_layer\n",
      "tran_Lmon              1   transpiration_flux\n",
      "ficeberg_Omon          1   water_flux_into_sea_water_from_icebergs\n",
      "friver_Omon            7   water_flux_into_sea_water_from_rivers\n",
      "hfbasin_Omon          10   northward_ocean_heat_transport\n",
      "hfcorr_Omon           14   heat_flux_correction\n",
      "hfds_Omon             66   surface_downward_heat_flux_in_sea_water\n",
      "hfx_Omon               1   ocean_heat_x_transport\n",
      "hfy_Omon               1   ocean_heat_y_transport\n",
      "htovgyre_Omon          2   northward_ocean_heat_transport_due_to_gyre\n",
      "htovovrt_Omon          2   northward_ocean_heat_transport_due_to_overturning\n",
      "mlotst_Omon          217   ocean_mixed_layer_thickness_defined_by_sigma_t\n",
      "msftbarot_Omon         4   ocean_barotropic_mass_streamfunction\n",
      "msftmyz_Omon          11   ocean_meridional_overturning_mass_streamfunction\n",
      "msftmz_Omon            5   ocean_meridional_overturning_mass_streamfunction\n",
      "msftyz_Omon            2   ocean_y_overturning_mass_streamfunction\n",
      "so_Omon              228   sea_water_salinity\n",
      "soga_Omon             11   sea_water_salinity\n",
      "sos_Omon              22   sea_surface_salinity\n",
      "tauuo_Omon           150   surface_downward_x_stress\n",
      "tauvo_Omon             4   surface_downward_y_stress\n",
      "thetao_Omon          472   sea_water_potential_temperature\n",
      "tos_Omon             228   sea_surface_temperature\n",
      "umo_Omon               6   ocean_mass_x_transport\n",
      "uo_Omon              318   sea_water_x_velocity\n",
      "vmo_Omon              29   ocean_mass_y_transport\n",
      "vo_Omon              443   sea_water_y_velocity\n",
      "wmo_Omon               1   upward_ocean_mass_transport\n",
      "zos_Omon              97   sea_surface_height_above_geoid\n",
      "uso_PrimOmon           4   product_of_xward_sea_water_velocity_and_salinity\n",
      "uto_PrimOmon           4   product_of_xward_sea_water_velocity_and_temperature\n",
      "vso_PrimOmon           4   product_of_yward_sea_water_velocity_and_salinity\n",
      "vto_PrimOmon          15   product_of_yward_sea_water_velocity_and_temperature\n",
      "wo_PrimOmon            2   upward_sea_water_velocity\n",
      "zg_PrimmonZ            2   geopotential_height\n",
      "siconc_SImon         152   sea_ice_area_fraction\n",
      "sispeed_SImon          9   sea_ice_speed\n",
      "sithick_SImon         35   sea_ice_thickness\n",
      "sitimefrac_SImon       2   sea_ice_time_fraction\n",
      "siu_SImon             25   sea_ice_x_velocity\n",
      "siv_SImon             98   sea_ice_y_velocity\n",
      "sivol_SImon          104   sea_ice_thickness\n"
     ]
    }
   ],
   "source": [
    "for vr in var_reqs_ordered:\n",
    "    print('{:<20} {:3}   {}'.format(vr.cmor_name + '_' + vr.table_name, var_reqs[vr], vr.standard_name))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Display them again in popularity order"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "pr_Amon              1261   precipitation_flux\n",
      "ts_Amon              834   surface_temperature\n",
      "psl_Amon             828   air_pressure_at_sea_level\n",
      "tas_Amon             692   air_temperature\n",
      "zg_day               544   geopotential_height\n",
      "ua_Amon              513   eastward_wind\n",
      "thetao_Omon          472   sea_water_potential_temperature\n",
      "vo_Omon              443   sea_water_y_velocity\n",
      "va_Amon              417   northward_wind\n",
      "pr_day               367   precipitation_flux\n",
      "zg_Amon              361   geopotential_height\n",
      "ta_Amon              354   air_temperature\n",
      "hus_Amon             333   specific_humidity\n",
      "evspsbl_Amon         329   water_evaporation_flux\n",
      "huss_Amon            323   specific_humidity\n",
      "ps_Amon              322   surface_air_pressure\n",
      "uo_Omon              318   sea_water_x_velocity\n",
      "clt_Amon             314   cloud_area_fraction\n",
      "hfls_Amon            236   surface_upward_latent_heat_flux\n",
      "hfss_Amon            234   surface_upward_sensible_heat_flux\n",
      "tos_Omon             228   sea_surface_temperature\n",
      "so_Omon              228   sea_water_salinity\n",
      "mlotst_Omon          217   ocean_mixed_layer_thickness_defined_by_sigma_t\n",
      "rlds_Amon            202   surface_downwelling_longwave_flux_in_air\n",
      "ua_day               194   eastward_wind\n",
      "rsds_Amon            178   surface_downwelling_shortwave_flux_in_air\n",
      "rsus_Amon            172   surface_upwelling_shortwave_flux_in_air\n",
      "va_day               161   northward_wind\n",
      "siconc_SImon         152   sea_ice_area_fraction\n",
      "tasmax_day           152   air_temperature\n",
      "tauuo_Omon           150   surface_downward_x_stress\n",
      "pr_3hr               146   precipitation_flux\n",
      "wap_Amon             144   lagrangian_tendency_of_air_pressure\n",
      "rlus_Amon            131   surface_upwelling_longwave_flux_in_air\n",
      "zg23_Primday         121   geopotential_height\n",
      "vas_6hrPlevPt        112   northward_wind\n",
      "zg7h_Prim3hrPt       111   geopotential_height\n",
      "uas_6hrPlevPt        110   eastward_wind\n",
      "zg7h_6hrPlevPt       107   geopotential_height\n",
      "sivol_SImon          104   sea_ice_thickness\n",
      "psl_6hrPlevPt        100   air_pressure_at_sea_level\n",
      "siv_SImon             98   sea_ice_y_velocity\n",
      "zos_Omon              97   sea_surface_height_above_geoid\n",
      "pr_Prim6hr            96   precipitation_flux\n",
      "rsut_Amon             88   toa_outgoing_shortwave_flux\n",
      "prw_Amon              87   atmosphere_water_vapor_content\n",
      "ta_day                85   air_temperature\n",
      "vas_day               84   northward_wind\n",
      "rlut_Amon             83   toa_outgoing_longwave_flux\n",
      "rsdt_Amon             82   toa_incoming_shortwave_flux\n",
      "uas_day               81   eastward_wind\n",
      "tas_day               74   air_temperature\n",
      "mrso_Lmon             72   soil_moisture_content\n",
      "uas_3hr               72   eastward_wind\n",
      "psl_day               72   air_pressure_at_sea_level\n",
      "vas_3hr               70   northward_wind\n",
      "prc_Amon              68   convective_precipitation_flux\n",
      "ua_6hrPlevPt          67   eastward_wind\n",
      "hfds_Omon             66   surface_downward_heat_flux_in_sea_water\n",
      "va_6hrPlevPt          65   northward_wind\n",
      "tasmin_day            64   air_temperature\n",
      "sfcWindmax_day        62   wind_speed\n",
      "hus_day               61   specific_humidity\n",
      "ua7h_6hrPlevPt        52   eastward_wind\n",
      "prc_Prim6hr           52   convective_precipitation_flux\n",
      "va7h_6hrPlevPt        48   northward_wind\n",
      "huss_3hr              48   specific_humidity\n",
      "rldscs_Amon           47   surface_downwelling_longwave_flux_in_air_assuming_clear_sky\n",
      "prw_E3hr              47   atmosphere_water_vapor_content\n",
      "ts_Primday            46   surface_temperature\n",
      "rsdscs_Amon           45   surface_downwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "rlds_3hr              45   surface_downwelling_longwave_flux_in_air\n",
      "rsutcs_Amon           43   toa_outgoing_shortwave_flux_assuming_clear_sky\n",
      "hfls_3hr              43   surface_upward_latent_heat_flux\n",
      "rlutcs_Amon           42   toa_outgoing_longwave_flux_assuming_clear_sky\n",
      "sfcWind_6hrPlevPt     38   wind_speed\n",
      "mrro_Lmon             38   runoff_flux\n",
      "rlus_3hr              38   surface_upwelling_longwave_flux_in_air\n",
      "hus7h_6hrPlevPt       37   specific_humidity\n",
      "sithick_SImon         35   sea_ice_thickness\n",
      "hur_Amon              34   relative_humidity\n",
      "snd_LImon             34   surface_snow_thickness\n",
      "mrlsl_Lmon            34   moisture_content_of_soil_layer\n",
      "hfss_3hr              34   surface_upward_sensible_heat_flux\n",
      "rsuscs_Amon           33   surface_upwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "ua7h_E3hrPt           33   eastward_wind\n",
      "rsus_3hr              33   surface_upwelling_shortwave_flux_in_air\n",
      "prsn_Amon             32   snowfall_flux\n",
      "vas_Amon              32   northward_wind\n",
      "sfcWind_day           31   wind_speed\n",
      "hfls_day              31   surface_upward_latent_heat_flux\n",
      "va7h_E3hrPt           30   northward_wind\n",
      "rldscs_3hr            30   surface_downwelling_longwave_flux_in_air_assuming_clear_sky\n",
      "uas_Prim1hr           29   eastward_wind\n",
      "uas_Amon              29   eastward_wind\n",
      "ta7h_E3hrPt           29   air_temperature\n",
      "vmo_Omon              29   ocean_mass_y_transport\n",
      "pr_E1hr               28   precipitation_flux\n",
      "epfz_EmonZ            28   upward_eliassen_palm_flux_in_air\n",
      "psl_E3hr              27   air_pressure_at_sea_level\n",
      "zg27_6hrPlevPt        27   geopotential_height\n",
      "tauu_Amon             26   surface_downward_eastward_stress\n",
      "tauv_Amon             26   surface_downward_northward_stress\n",
      "mrro_day              26   runoff_flux\n",
      "siu_SImon             25   sea_ice_x_velocity\n",
      "huss_day              25   specific_humidity\n",
      "tasmax_Amon           25   air_temperature\n",
      "vas_Prim1hr           24   northward_wind\n",
      "rlut_day              24   toa_outgoing_longwave_flux\n",
      "hus7h_E3hrPt          24   specific_humidity\n",
      "tasmin_Amon           23   air_temperature\n",
      "tos_Oday              22   sea_surface_temperature\n",
      "sos_Omon              22   sea_surface_salinity\n",
      "mrro_3hr              22   runoff_flux\n",
      "huss_6hrPlevPt        21   specific_humidity\n",
      "cl_Amon               20   cloud_area_fraction_in_atmosphere_layer\n",
      "hfss_day              19   surface_upward_sensible_heat_flux\n",
      "tas_Prim1hr           18   air_temperature\n",
      "siv_SIday             18   sea_ice_y_velocity\n",
      "ps_3hr                18   surface_air_pressure\n",
      "wap_day               18   lagrangian_tendency_of_air_pressure\n",
      "mrsos_day             18   moisture_content_of_soil_layer\n",
      "clt_day               18   cloud_area_fraction\n",
      "siu_SIday             17   sea_ice_x_velocity\n",
      "sfcWind_Prim3hr       17   wind_speed\n",
      "rsds_3hr              15   surface_downwelling_shortwave_flux_in_air\n",
      "ps_Prim6hr            15   surface_air_pressure\n",
      "vto_PrimOmon          15   product_of_yward_sea_water_velocity_and_temperature\n",
      "rlds_day              15   surface_downwelling_longwave_flux_in_air\n",
      "psl_6hrPlev           14   air_pressure_at_sea_level\n",
      "zg10_Primday          14   geopotential_height\n",
      "hfcorr_Omon           14   heat_flux_correction\n",
      "tas_3hr               13   air_temperature\n",
      "prc_3hr               11   convective_precipitation_flux\n",
      "msftmyz_Omon          11   ocean_meridional_overturning_mass_streamfunction\n",
      "soga_Omon             11   sea_water_salinity\n",
      "ps_CFday              10   surface_air_pressure\n",
      "hfbasin_Omon          10   northward_ocean_heat_transport\n",
      "sispeed_SImon          9   sea_ice_speed\n",
      "evspsbl_Primday        9   water_evaporation_flux\n",
      "ua23_Primday           9   eastward_wind\n",
      "prsn_3hr               9   snowfall_flux\n",
      "rsds_Prim1hr           8   surface_downwelling_shortwave_flux_in_air\n",
      "clwvi_CFday            8   atmosphere_cloud_condensed_water_content\n",
      "psl_E3hrPt             8   air_pressure_at_sea_level\n",
      "zg_EdayZ               8   geopotential_height\n",
      "tas_6hrPlevPt          8   air_temperature\n",
      "mrsos_3hr              8   moisture_content_of_soil_layer\n",
      "va23_Primday           8   northward_wind\n",
      "ta23_Primday           8   air_temperature\n",
      "snw_LImon              7   surface_snow_amount\n",
      "friver_Omon            7   water_flux_into_sea_water_from_rivers\n",
      "wsgmax_Prim6hr         7   wind_speed_of_gust\n",
      "mrsos_Lmon             7   moisture_content_of_soil_layer\n",
      "uqint_Emon             7   integral_of_product_of_eastward_wind_and_specific_humidity_wrt_height\n",
      "vqint_Emon             7   integral_of_product_of_northward_wind_and_specific_humidity_wrt_height\n",
      "ta_6hrPlevPt           6   air_temperature\n",
      "ta7h_6hrPlevPt         6   air_temperature\n",
      "pfull_Amon             6   air_pressure\n",
      "clivi_CFday            6   atmosphere_cloud_ice_content\n",
      "zos_PrimOday           6   sea_surface_height_above_geoid\n",
      "umo_Omon               6   ocean_mass_x_transport\n",
      "phalf_Amon             5   air_pressure\n",
      "rsut_CFday             5   toa_outgoing_shortwave_flux\n",
      "siconc_SIday           5   sea_ice_area_fraction\n",
      "mrros_Lmon             5   surface_runoff_flux\n",
      "rsdt_CFday             5   toa_incoming_shortwave_flux\n",
      "msftmz_Omon            5   ocean_meridional_overturning_mass_streamfunction\n",
      "snc_LImon              5   surface_snow_area_fraction\n",
      "va50m_Prim1hr          4   northward_wind\n",
      "ua50m_Prim1hr          4   eastward_wind\n",
      "clt_Prim1hr            4   cloud_area_fraction_in_atmosphere_layer\n",
      "clw_Amon               4   mass_fraction_of_cloud_liquid_water_in_air\n",
      "cli_Amon               4   mass_fraction_of_cloud_ice_in_air\n",
      "rlucs_CFmon            4   upwelling_longwave_flux_in_air_assuming_clear_sky\n",
      "ua_CFday               4   eastward_wind\n",
      "va_CFday               4   northward_wind\n",
      "ps_Prim6hrPt           4   surface_air_pressure\n",
      "wap7h_E3hrPt           4   lagrangian_tendency_of_air_pressure\n",
      "tauvo_Omon             4   surface_downward_y_stress\n",
      "snw_day                4   surface_snow_amount\n",
      "uto_PrimOmon           4   product_of_xward_sea_water_velocity_and_temperature\n",
      "uso_PrimOmon           4   product_of_xward_sea_water_velocity_and_salinity\n",
      "vso_PrimOmon           4   product_of_yward_sea_water_velocity_and_salinity\n",
      "msftbarot_Omon         4   ocean_barotropic_mass_streamfunction\n",
      "tauu_Eday              4   surface_downward_eastward_stress\n",
      "ua100m_Prim3hrPt       3   eastward_wind\n",
      "va100m_Prim3hrPt       3   northward_wind\n",
      "rsdscs_3hr             3   surface_downwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "hurs_Amon              3   relative_humidity\n",
      "sfcWind_Amon           3   wind_speed\n",
      "clw_CFday              3   mass_fraction_of_cloud_liquid_water_in_air\n",
      "phalf_CFday            3   air_pressure\n",
      "va4_Prim6hr            3   northward_wind\n",
      "rsdsdiff_Prim1hr       2   surface_diffuse_downwelling_shortwave_flux_in_air\n",
      "clt_Prim6hr            2   cloud_area_fraction\n",
      "clt_Prim6hrPt          2   cloud_area_fraction\n",
      "zg_PrimmonZ            2   geopotential_height\n",
      "rlutcs_CFday           2   toa_outgoing_longwave_flux_assuming_clear_sky\n",
      "rsutcs_CFday           2   toa_outgoing_shortwave_flux_assuming_clear_sky\n",
      "hus4_Prim6hr           2   specific_humidity\n",
      "ua4_Prim6hr            2   eastward_wind\n",
      "clt_3hr                2   cloud_area_fraction\n",
      "htovgyre_Omon          2   northward_ocean_heat_transport_due_to_gyre\n",
      "htovovrt_Omon          2   northward_ocean_heat_transport_due_to_overturning\n",
      "hfls_Prim6hr           2   surface_upward_latent_heat_flux\n",
      "msftyz_Omon            2   ocean_y_overturning_mass_streamfunction\n",
      "vo_PrimOday            2   sea_water_y_velocity\n",
      "ua_Eday                2   eastward_wind\n",
      "sitimefrac_SImon       2   sea_ice_time_fraction\n",
      "ua_PrimdayPt           2   eastward_wind\n",
      "rsdt_E3hr              2   toa_incoming_shortwave_flux\n",
      "wo_PrimOmon            2   upward_sea_water_velocity\n",
      "ua50m_Prim3hrPt        1   eastward_wind\n",
      "va50m_Prim3hrPt        1   northward_wind\n",
      "tso_3hr                1   sea_surface_temperature\n",
      "ts_6hrPlevPt           1   surface_temperature\n",
      "ua850_E3hrPt           1   eastward_wind\n",
      "va850_E3hrPt           1   northward_wind\n",
      "ficeberg_Omon          1   water_flux_into_sea_water_from_icebergs\n",
      "tran_Lmon              1   transpiration_flux\n",
      "hus_CFmon              1   specific_humidity\n",
      "hur_CFmon              1   relative_humidity\n",
      "ta_CFmon               1   air_temperature\n",
      "rsdcs_CFmon            1   downwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "rldcs_CFmon            1   downwelling_longwave_flux_in_air_assuming_clear_sky\n",
      "rsucs_CFmon            1   upwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "rsd_CFmon              1   downwelling_shortwave_flux_in_air\n",
      "rld_CFmon              1   downwelling_longwave_flux_in_air\n",
      "rsu_CFmon              1   upwelling_shortwave_flux_in_air\n",
      "rlu_CFmon              1   upwelling_longwave_flux_in_air\n",
      "hfx_Omon               1   ocean_heat_x_transport\n",
      "hfy_Omon               1   ocean_heat_y_transport\n",
      "uo_PrimOday            1   sea_water_x_velocity\n",
      "tsn_LImon              1   temperature_in_surface_snow\n",
      "va_Eday                1   northward_wind\n",
      "wmo_Omon               1   upward_ocean_mass_transport\n",
      "va10_Primday           1   northward_wind\n",
      "ua10_Primday           1   eastward_wind\n",
      "hus10_Primday          1   specific_humidity\n",
      "tos_3hr                1   sea_surface_temperature\n",
      "tslsi_3hr              1   surface_temperature\n",
      "ua1000_Prim6hrPt       1   eastward_wind\n",
      "psl_CF3hr              1   air_pressure_at_sea_level\n",
      "sftlf_fx               1   land_area_fraction\n",
      "sfcWindmax_Prim3hr     1   wind_speed\n",
      "sfcWindmax_Prim6hr     1   wind_speed_of_gust\n",
      "rsds_Prim6hr           1   surface_downwelling_shortwave_flux_in_air\n",
      "vortmean_6hrPlevPt     1   atmosphere_relative_vorticity\n"
     ]
    }
   ],
   "source": [
    "popularity_ordered = OrderedDict(sorted(var_reqs.items(), key=lambda x: x[1], reverse=True))\n",
    "for vr in popularity_ordered:\n",
    "    print('{:<20} {:3}   {}'.format(vr.cmor_name + '_' + vr.table_name, var_reqs[vr], vr.standard_name))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Look at the variables that have never been retrieved.\n",
    "\n",
    "Below is a list of the Stream 1 and 2 variables that have been uploaded by at least one model, but have never been requested for retrieval from tape to disk."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "prc_E1hr                convective_precipitation_flux\n",
      "ps_Prim1hr              surface_air_pressure\n",
      "rsdsdiffmax_Prim1hr     surface_diffuse_downwelling_shortwave_flux_in_air\n",
      "rsdsdiffmin_Prim1hr     surface_diffuse_downwelling_shortwave_flux_in_air\n",
      "rsdsmax_Prim1hr         surface_downwelling_shortwave_flux_in_air\n",
      "rsdsmin_Prim1hr         surface_downwelling_shortwave_flux_in_air\n",
      "sfcWindmax_Prim1hr      wind_speed\n",
      "sfcWindmin_Prim1hr      wind_speed\n",
      "wsgmax_Prim1hr          wind_speed_of_gust\n",
      "rsdsdiff_3hr            surface_diffuse_downwelling_shortwave_flux_in_air\n",
      "rsuscs_3hr              surface_upwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "clivi_E3hr              atmosphere_cloud_ice_content\n",
      "clwvi_E3hr              atmosphere_cloud_condensed_water_content\n",
      "prcsh_E3hr              hallow_convective_precipitation_flux\n",
      "prra_E3hr               rainfall_flux\n",
      "rlut_E3hr               toa_outgoing_longwave_flux\n",
      "rlutcs_E3hr             toa_outgoing_longwave_flux_assuming_clear_sky\n",
      "rsut_E3hr               toa_outgoing_shortwave_flux\n",
      "rsutcs_E3hr             toa_outgoing_shortwave_flux_assuming_clear_sky\n",
      "clisccp_E3hrPt          cloud_area_fraction_in_atmosphere_layer\n",
      "evspsbl_Prim3hr         water_evaporation_flux\n",
      "hus100_Prim3hrPt        specific_humidity\n",
      "hus1000_Prim3hrPt       specific_humidity\n",
      "ta100_Prim3hrPt         air_temperature\n",
      "ua100_Prim3hrPt         eastward_wind\n",
      "ua1000_Prim3hrPt        eastward_wind\n",
      "va100_Prim3hrPt         northward_wind\n",
      "va1000_Prim3hrPt        northward_wind\n",
      "vortmean_Prim3hrPt      atmosphere_relative_vorticity\n",
      "ps_CF3hr                surface_air_pressure\n",
      "sfcWind_CF3hr           wind_speed\n",
      "albdiffbnd_E3hrPt       band_diffuse_albedo\n",
      "albdirbnd_E3hrPt        band_direct_albedo\n",
      "ps_E3hrPt               surface_air_pressure\n",
      "hus4_6hrPlev            specific_humidity\n",
      "pr_6hrPlev              precipitation_flux\n",
      "tas_6hrPlev             air_temperature\n",
      "uas_6hrPlev             eastward_wind\n",
      "vas_6hrPlev             northward_wind\n",
      "wap4_6hrPlev            lagrangian_tendency_of_air_pressure\n",
      "zg1000_6hrPlev          geopotential_height\n",
      "hus27_6hrPlevPt         specific_humidity\n",
      "mrlsl_6hrPlevPt         moisture_content_of_soil_layer\n",
      "mrsos_6hrPlevPt         moisture_content_of_soil_layer\n",
      "snw_6hrPlevPt           surface_snow_amount\n",
      "ta27_6hrPlevPt          air_temperature\n",
      "tsl_6hrPlevPt           soil_temperature\n",
      "wbptemp7h_6hrPlevPt     wet_bulb_potential_temperature\n",
      "zg500_6hrPlevPt         geopotential_height\n",
      "hfss_Prim6hr            surface_upward_sensible_heat_flux\n",
      "mrro_Prim6hr            runoff_flux\n",
      "prsn_Prim6hr            snowfall_flux\n",
      "rlds_Prim6hr            surface_downwelling_longwave_flux_in_air\n",
      "rldscs_Prim6hr          surface_downwelling_longwave_flux_in_air_assuming_clear_sky\n",
      "rlus_Prim6hr            surface_upwelling_longwave_flux_in_air\n",
      "rsdscs_Prim6hr          surface_downwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "rsdsdiff_Prim6hr        surface_diffuse_downwelling_shortwave_flux_in_air\n",
      "rsus_Prim6hr            surface_upwelling_shortwave_flux_in_air\n",
      "rsuscs_Prim6hr          surface_upwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "hus1000_Prim6hrPt       specific_humidity\n",
      "thetapv2_Prim6hrPt      theta_on_pv2_surface\n",
      "tslsi_Prim6hrPt         surface_temperature\n",
      "tso_Prim6hrPt           sea_surface_temperature\n",
      "va1000_Prim6hrPt        northward_wind\n",
      "uo_PrimO6hr             sea_water_x_velocity\n",
      "vo_PrimO6hr             sea_water_y_velocity\n",
      "rv850_6hrPlevPt         atmosphere_relative_vorticity\n",
      "ua850_6hrPlevPt         eastward_wind\n",
      "va850_6hrPlevPt         northward_wind\n",
      "zg500_AERday            geopotential_height\n",
      "albisccp_CFday          cloud_albedo\n",
      "ccb_CFday               air_pressure_at_convective_cloud_base\n",
      "cct_CFday               air_pressure_at_convective_cloud_top\n",
      "cl_CFday                cloud_area_fraction_in_atmosphere_layer\n",
      "clcalipso_CFday         cloud_area_fraction_in_atmosphere_layer\n",
      "clhcalipso_CFday        cloud_area_fraction_in_atmosphere_layer\n",
      "cli_CFday               mass_fraction_of_cloud_ice_in_air\n",
      "clisccp_CFday           cloud_area_fraction_in_atmosphere_layer\n",
      "cllcalipso_CFday        cloud_area_fraction_in_atmosphere_layer\n",
      "clmcalipso_CFday        cloud_area_fraction_in_atmosphere_layer\n",
      "cltcalipso_CFday        cloud_area_fraction\n",
      "cltisccp_CFday          cloud_area_fraction\n",
      "hur_CFday               relative_humidity\n",
      "hus_CFday               specific_humidity\n",
      "mc_CFday                atmosphere_net_upward_convective_mass_flux\n",
      "pctisccp_CFday          air_pressure_at_cloud_top\n",
      "pfull_CFday             air_pressure\n",
      "rldscs_CFday            surface_downwelling_longwave_flux_in_air_assuming_clear_sky\n",
      "rsdscs_CFday            surface_downwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "rsuscs_CFday            surface_upwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "ta_CFday                air_temperature\n",
      "ta700_CFday             air_temperature\n",
      "wap_CFday               lagrangian_tendency_of_air_pressure\n",
      "wap500_CFday            lagrangian_tendency_of_air_pressure\n",
      "zg_CFday                geopotential_height\n",
      "hur_day                 relative_humidity\n",
      "hurs_day                relative_humidity\n",
      "hursmax_day             relative_humidity\n",
      "hursmin_day             relative_humidity\n",
      "mrso_day                soil_moisture_content\n",
      "omldamax_day            ocean_mixed_layer_thickness_defined_by_mixing_scheme\n",
      "prc_day                 convective_precipitation_flux\n",
      "prsn_day                snowfall_flux\n",
      "rlus_day                surface_upwelling_longwave_flux_in_air\n",
      "rsds_day                surface_downwelling_shortwave_flux_in_air\n",
      "rsus_day                surface_upwelling_shortwave_flux_in_air\n",
      "snc_day                 surface_snow_area_fraction\n",
      "tslsi_day               surface_temperature\n",
      "hus_Eday                specific_humidity\n",
      "lwsnl_Eday              liquid_water_content_of_snow_layer\n",
      "mlotst_Eday             ocean_mixed_layer_thickness_defined_by_sigma_t\n",
      "mrros_Eday              surface_runoff_flux\n",
      "mrsol_Eday              moisture_content_of_soil_layer\n",
      "rivo_Eday               water_flux_to_downstream\n",
      "rzwc_Eday               water_content_of_root_zone\n",
      "sic_Eday                sea_ice_area_fraction\n",
      "snd_Eday                surface_snow_thickness\n",
      "snm_Eday                surface_snow_melt_flux\n",
      "snw_Eday                surface_snow_amount\n",
      "t20d_Eday               depth_of_isosurface_of_sea_water_potential_temperature\n",
      "ta_Eday                 air_temperature\n",
      "ta850_Eday              air_temperature\n",
      "tauv_Eday               surface_downward_northward_stress\n",
      "tdps_Eday               dew_point_temperature\n",
      "ts_Eday                 surface_temperature\n",
      "epfz_EdayZ              upward_eliassen_palm_flux_in_air\n",
      "utendnogw_EdayZ         tendency_of_eastward_wind_due_to_nonorographic_gravity_wave_drag\n",
      "utendogw_EdayZ          tendency_of_eastward_wind_due_to_orographic_gravity_wave_drag\n",
      "vtem_EdayZ              northward_transformed_eulerian_mean_air_velocity\n",
      "wtem_EdayZ              unset\n",
      "omldamax_Oday           ocean_mixed_layer_thickness_defined_by_mixing_scheme\n",
      "sos_Oday                sea_surface_salinity\n",
      "tossq_Oday              square_of_sea_surface_temperature\n",
      "hus23_Primday           specific_humidity\n",
      "mrlsl_Primday           moisture_content_of_soil_layer\n",
      "mrso_Primday            soil_moisture_content\n",
      "prmax_Primday           precipitation_flux\n",
      "prmin_Primday           precipitation_flux\n",
      "ta10_Primday            air_temperature\n",
      "uneutrals_Primday       eastward_neurtral_wind\n",
      "vneutrals_Primday       northward_neutral_wind\n",
      "wap10_Primday           lagrangian_tendency_of_air_pressure\n",
      "wap23_Primday           lagrangian_tendency_of_air_pressure\n",
      "va_PrimdayPt            northward_wind\n",
      "mlotst_PrimOday         ocean_mixed_layer_thickness_defined_by_sigma_t\n",
      "so_PrimOday             sea_water_salinity\n",
      "tauuo_PrimOday          surface_downward_x_stress\n",
      "tauvo_PrimOday          surface_downward_y_stress\n",
      "thetao_PrimOday         sea_water_potential_temperature\n",
      "sidivvel_PrimSIday      divergence_of_sea_ice_velocity\n",
      "siforceintstrx_PrimSIday internal_stress_in_sea_ice_x\n",
      "siforceintstry_PrimSIday internal_stress_in_sea_ice_y\n",
      "simassacrossline_PrimSIday sea_ice_transport_across_line\n",
      "sistrxdtop_PrimSIday    surface_downward_x_stress\n",
      "sistrxubot_PrimSIday    sea_ice_base_upward_x_stress\n",
      "sistrydtop_PrimSIday    surface_downward_y_stress\n",
      "sistryubot_PrimSIday    sea_ice_base_upward_y_stress\n",
      "sitimefrac_PrimSIday    sea_ice_time_fraction\n",
      "siu_PrimSIday           sea_ice_x_velocity\n",
      "siv_PrimSIday           sea_ice_y_velocity\n",
      "siconca_SIday           sea_ice_area_fraction\n",
      "sisnthick_SIday         surface_snow_thickness\n",
      "sispeed_SIday           sea_ice_speed\n",
      "sitemptop_SIday         sea_ice_surface_temperature\n",
      "sithick_SIday           sea_ice_thickness\n",
      "sitimefrac_SIday        sea_ice_time_fraction\n",
      "sftgrf_Efx              grounded_ice_sheet_area_fraction\n",
      "areacella_fx            cell_area\n",
      "areacellr_fx            cell_area\n",
      "mrsofc_fx               soil_moisture_content_at_field_capacity\n",
      "orog_fx                 surface_altitude\n",
      "rootd_fx                root_depth\n",
      "sftgif_fx               land_ice_area_fraction\n",
      "zfull_fx                height_above_reference_ellipsoid\n",
      "areacello_Ofx           cell_area\n",
      "basin_Ofx               region\n",
      "deptho_Ofx              sea_floor_depth_below_geoid\n",
      "hfgeou_Ofx              upward_geothermal_heat_flux_at_sea_floor\n",
      "masscello_Ofx           sea_water_mass_per_unit_area\n",
      "thkcello_Ofx            cell_thickness\n",
      "volcello_Ofx            ocean_volume\n",
      "abs550aer_AERmon        atmosphere_absorption_optical_thickness_due_to_ambient_aerosol\n",
      "cltc_AERmon             convective_cloud_area_fraction\n",
      "cod_AERmon              atmosphere_optical_thickness_due_to_cloud\n",
      "lwp_AERmon              atmosphere_mass_content_of_cloud_liquid_water\n",
      "od550aer_AERmon         atmosphere_optical_thickness_due_to_ambient_aerosol_particles\n",
      "od550bc_AERmon          atmosphere_optical_thickness_due_to_black_carbon_ambient_aerosol\n",
      "od550dust_AERmon        atmosphere_optical_thickness_due_to_dust_ambient_aerosol\n",
      "od550oa_AERmon          atmosphere_optical_thickness_due_to_particulate_organic_matter_ambient_aerosol\n",
      "od550so4_AERmon         atmosphere_optical_thickness_due_to_sulfate_ambient_aerosol\n",
      "od550ss_AERmon          atmosphere_optical_thickness_due_to_seasalt_ambient_aerosol\n",
      "ps_AERmon               surface_air_pressure\n",
      "ptp_AERmon              tropopause_air_pressure\n",
      "reffclwtop_AERmon       effective_radius_of_cloud_liquid_water_particle_at_liquid_water_cloud_top\n",
      "rlutaf_AERmon           toa_outgoing_longwave_flux\n",
      "rlutcsaf_AERmon         toa_outgoing_longwave_flux_assuming_clear_sky\n",
      "rsutaf_AERmon           toa_outgoing_shortwave_flux\n",
      "rsutcsaf_AERmon         toa_outgoing_shortwave_flux_assuming_clear_sky\n",
      "tatp_AERmon             tropopause_air_temperature\n",
      "toz_AERmon              equivalent_thickness_at_stp_of_atmosphere_ozone_content\n",
      "ttop_AERmon             air_temperature_at_cloud_top\n",
      "ua_AERmon               eastward_wind\n",
      "va_AERmon               northward_wind\n",
      "ztp_AERmon              tropopause_altitude\n",
      "ccb_Amon                air_pressure_at_convective_cloud_base\n",
      "cct_Amon                air_pressure_at_convective_cloud_top\n",
      "ch4global_Amon          mole_fraction_of_methane_in_air\n",
      "ci_Amon                 convection_time_fraction\n",
      "clivi_Amon              atmosphere_cloud_ice_content\n",
      "clwvi_Amon              atmosphere_cloud_condensed_water_content\n",
      "co2mass_Amon            atmosphere_mass_of_carbon_dioxide\n",
      "mc_Amon                 atmosphere_net_upward_convective_mass_flux\n",
      "n2oglobal_Amon          mole_fraction_of_nitrous_oxide_in_air\n",
      "rtmt_Amon               net_downward_radiative_flux_at_top_of_atmosphere_model\n",
      "sbl_Amon                surface_snow_and_ice_sublimation_flux\n",
      "sci_Amon                shallow_convection_time_fraction\n",
      "albisccp_CFmon          cloud_albedo\n",
      "clc_CFmon               convective_cloud_area_fraction_in_atmosphere_layer\n",
      "clcalipso_CFmon         cloud_area_fraction_in_atmosphere_layer\n",
      "clhcalipso_CFmon        cloud_area_fraction_in_atmosphere_layer\n",
      "clic_CFmon              mass_fraction_of_convective_cloud_ice_in_air\n",
      "clis_CFmon              mass_fraction_of_stratiform_cloud_ice_in_air\n",
      "clisccp_CFmon           cloud_area_fraction_in_atmosphere_layer\n",
      "cllcalipso_CFmon        cloud_area_fraction_in_atmosphere_layer\n",
      "clmcalipso_CFmon        cloud_area_fraction_in_atmosphere_layer\n",
      "cls_CFmon               stratiform_cloud_area_fraction_in_atmosphere_layer\n",
      "cltcalipso_CFmon        cloud_area_fraction\n",
      "cltisccp_CFmon          cloud_area_fraction\n",
      "clwc_CFmon              mass_fraction_of_convective_cloud_liquid_water_in_air\n",
      "clws_CFmon              mass_fraction_of_stratiform_cloud_liquid_water_in_air\n",
      "mcd_CFmon               atmosphere_downdraft_convective_mass_flux\n",
      "mcu_CFmon               atmosphere_updraft_convective_mass_flux\n",
      "pctisccp_CFmon          air_pressure_at_cloud_top\n",
      "rld4co2_CFmon           downwelling_longwave_flux_in_air\n",
      "rldcs4co2_CFmon         downwelling_longwave_flux_in_air_assuming_clear_sky\n",
      "rlu4co2_CFmon           upwelling_longwave_flux_in_air\n",
      "rlucs4co2_CFmon         upwelling_longwave_flux_in_air_assuming_clear_sky\n",
      "rlut4co2_CFmon          toa_outgoing_longwave_flux\n",
      "rlutcs4co2_CFmon        toa_outgoing_longwave_flux_assuming_clear_sky\n",
      "rsd4co2_CFmon           downwelling_shortwave_flux_in_air\n",
      "rsdcs4co2_CFmon         downwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "rsu4co2_CFmon           upwelling_shortwave_flux_in_air\n",
      "rsucs4co2_CFmon         upwelling_shortwave_flux_in_air_assuming_clear_sky\n",
      "rsut4co2_CFmon          toa_outgoing_shortwave_flux\n",
      "rsutcs4co2_CFmon        toa_outgoing_shortwave_flux_assuming_clear_sky\n",
      "tnhus_CFmon             tendency_of_specific_humidity\n",
      "tnhusa_CFmon            tendency_of_specific_humidity_due_to_advection\n",
      "tnhusc_CFmon            tendency_of_specific_humidity_due_to_convection\n",
      "tnhusmp_CFmon           tendency_of_specific_humidity_due_to_model_physics\n",
      "tnhusscpbl_CFmon        tendency_of_specific_humidity_due_to_stratiform_cloud_and_precipitation_and_boundary_layer_mixing\n",
      "tnt_CFmon               tendency_of_air_temperature\n",
      "tnta_CFmon              tendency_of_air_temperature_due_to_advection\n",
      "tntc_CFmon              tendency_of_air_temperature_due_to_convection\n",
      "tntmp_CFmon             tendency_of_air_temperature_due_to_model_physics\n",
      "tntr_CFmon              tendency_of_air_temperature_due_to_radiative_heating\n",
      "tntscpbl_CFmon          tendency_of_air_temperature_due_to_stratiform_cloud_and_precipitation_and_boundary_layer_mixing\n",
      "cldicemxrat27_Emon      cloud_ice_mixing_ratio\n",
      "cldwatmxrat27_Emon      cloud_liquid_water_mixing_ratio\n",
      "clwvic_Emon             atmosphere_convective_cloud_condensed_water_content\n",
      "cropFracC3_Emon         area_fraction\n",
      "cropFracC4_Emon         area_fraction\n",
      "evspsblpot_Emon         water_potential_evaporation_flux\n",
      "grassFracC3_Emon        area_fraction\n",
      "grassFracC4_Emon        area_fraction\n",
      "hcont300_Emon           heat_content_of_ocean_layer\n",
      "hus_Emon                specific_humidity\n",
      "hus27_Emon              specific_humidity\n",
      "intuadse_Emon           vertical_integral_eastward_wind_by_dry_static_energy\n",
      "intuaw_Emon             vertical_integral_eastward_wind_by_total_water\n",
      "intvadse_Emon           vertical_integral_northward_wind_by_dry_static_energy\n",
      "intvaw_Emon             vertical_integral_northward_wind_by_total_water\n",
      "mrsol_Emon              moisture_content_of_soil_layer\n",
      "mrtws_Emon              total_water_storage\n",
      "nep_Emon                surface_net_downward_mass_flux_of_carbon_dioxide_expressed_as_carbon_due_to_all_land_processes_excluding_anthropogenic_land_use_change\n",
      "nwdFracLut_Emon         missing\n",
      "orog_Emon               surface_altitude\n",
      "parasolRefl_Emon        toa_bidirectional_reflectance\n",
      "rls_Emon                surface_net_downward_longwave_flux\n",
      "rss_Emon                surface_net_downward_shortwave_flux\n",
      "sfcWindmax_Emon         wind_speed\n",
      "t2_Emon                 square_of_air_temperature\n",
      "t20d_Emon               depth_of_isosurface_of_sea_water_potential_temperature\n",
      "ta27_Emon               air_temperature\n",
      "thetaot_Emon            sea_water_potential_temperature\n",
      "thetaot2000_Emon        sea_water_potential_temperature\n",
      "thetaot300_Emon         sea_water_potential_temperature\n",
      "thetaot700_Emon         sea_water_potential_temperature\n",
      "tntmp27_Emon            tendency_of_air_temperature_due_to_model_physics\n",
      "tntrl27_Emon            tendency_of_air_temperature_due_to_longwave_heating\n",
      "tntrs27_Emon            tendency_of_air_temperature_due_to_shortwave_heating\n",
      "twap_Emon               product_of_omega_and_air_temperature\n",
      "u2_Emon                 square_of_eastward_wind\n",
      "ua27_Emon               eastward_wind\n",
      "ut_Emon                 product_of_eastward_wind_and_air_temperature\n",
      "uv_Emon                 product_of_eastward_wind_and_northward_wind\n",
      "uwap_Emon               product_of_eastward_wind_and_omega\n",
      "v2_Emon                 square_of_northward_wind\n",
      "va27_Emon               northward_wind\n",
      "vegFrac_Emon            area_fraction\n",
      "vt_Emon                 product_of_northward_wind_and_air_temperature\n",
      "vwap_Emon               product_of_northward_wind_and_omega\n",
      "wap_Emon                lagrangian_tendency_of_air_pressure\n",
      "wap2_Emon               square_of_lagrangian_tendency_of_air_pressure\n",
      "wtd_Emon                depth_of_soil_moisture_saturation\n",
      "zg27_Emon               geopotential_height\n",
      "utendnogw_EmonZ         tendency_of_eastward_wind_due_to_nonorographic_gravity_wave_drag\n",
      "vtem_EmonZ              northward_transformed_eulerian_mean_air_velocity\n",
      "vtendnogw_EmonZ         tendency_of_northward_wind_due_to_nonorographic_gravity_wave_drag\n",
      "wtem_EmonZ              unset\n",
      "agesno_LImon            age_of_surface_snow\n",
      "hfdsn_LImon             surface_downward_heat_flux_in_snow\n",
      "lwsnl_LImon             liquid_water_content_of_snow_layer\n",
      "sbl_LImon               surface_snow_and_ice_sublimation_flux\n",
      "sftgif_LImon            land_ice_area_fraction\n",
      "sftgrf_LImon            grounded_ice_sheet_area_fraction\n",
      "snm_LImon               surface_snow_melt_flux\n",
      "baresoilFrac_Lmon       area_fraction\n",
      "c3PftFrac_Lmon          area_fraction\n",
      "c4PftFrac_Lmon          area_fraction\n",
      "cropFrac_Lmon           area_fraction\n",
      "evspsblsoi_Lmon         water_evaporation_flux_from_soil\n",
      "evspsblveg_Lmon         water_evaporation_flux_from_canopy\n",
      "gpp_Lmon                gross_primary_productivity_of_biomass_expressed_as_carbon\n",
      "grassFrac_Lmon          area_fraction\n",
      "lai_Lmon                leaf_area_index\n",
      "landCoverFrac_Lmon      area_fraction\n",
      "mrfso_Lmon              soil_frozen_water_content\n",
      "npp_Lmon                net_primary_productivity_of_biomass_expressed_as_carbon\n",
      "prveg_Lmon              precipitation_flux_onto_canopy\n",
      "ra_Lmon                 plant_respiration_carbon_flux\n",
      "residualFrac_Lmon       area_fraction\n",
      "rh_Lmon                 heterotrophic_respiration_carbon_flux\n",
      "treeFrac_Lmon           area_fraction\n",
      "tsl_Lmon                soil_temperature\n",
      "agessc_Omon             sea_water_age_since_surface_contact\n",
      "bigthetao_Omon          sea_water_conservative_temperature\n",
      "bigthetaoga_Omon        sea_water_conservative_temperature\n",
      "evs_Omon                water_evaporation_flux\n",
      "ficeberg2d_Omon         water_flux_into_sea_water_from_icebergs\n",
      "fsitherm_Omon           water_flux_into_sea_water_due_to_sea_ice_thermodynamics\n",
      "hfbasinpadv_Omon        northward_ocean_heat_transport_due_to_parameterized_eddy_advection\n",
      "hfbasinpmadv_Omon       northward_ocean_heat_transport_due_to_parameterized_mesoscale_advection\n",
      "hfbasinpmdiff_Omon      northward_ocean_heat_transport_due_to_parameterized_mesoscale_diffusion\n",
      "hfevapds_Omon           temperature_flux_due_to_evaporation_expressed_as_heat_flux_out_of_sea_water\n",
      "hfgeou_Omon             upward_geothermal_heat_flux_at_sea_floor\n",
      "hfrainds_Omon           temperature_flux_due_to_rainfall_expressed_as_heat_flux_into_sea_water\n",
      "hfrunoffds2d_Omon       temperature_flux_due_to_runoff_expressed_as_heat_flux_into_sea_water\n",
      "masscello_Omon          sea_water_mass_per_unit_area\n",
      "masso_Omon              sea_water_mass\n",
      "mfo_Omon                sea_water_transport_across_line\n",
      "mlotstmax_Omon          ocean_mixed_layer_thickness_defined_by_sigma_t\n",
      "mlotstmin_Omon          ocean_mixed_layer_thickness_defined_by_sigma_t\n",
      "mlotstsq_Omon           square_of_ocean_mixed_layer_thickness_defined_by_sigma_t\n",
      "msftmzmpa_Omon          ocean_meridional_overturning_mass_streamfunction_due_to_parameterized_mesoscale_advection\n",
      "obvfsq_Omon             square_of_brunt_vaisala_frequency_in_sea_water\n",
      "pbo_Omon                sea_water_pressure_at_sea_floor\n",
      "prlq_Omon               rainfall_flux\n",
      "prsn_Omon               snowfall_flux\n",
      "rsdo_Omon               downwelling_shortwave_flux_in_sea_water\n",
      "rsntds_Omon             net_downward_shortwave_flux_at_sea_water_surface\n",
      "sfdsi_Omon              downward_sea_ice_basal_salt_flux\n",
      "sltovgyre_Omon          northward_ocean_salt_transport_due_to_gyre\n",
      "sltovovrt_Omon          northward_ocean_salt_transport_due_to_overturning\n",
      "sob_Omon                sea_water_salinity_at_sea_floor\n",
      "sosga_Omon              sea_surface_salinity\n",
      "thetaoga_Omon           sea_water_potential_temperature\n",
      "thkcello_Omon           cell_thickness\n",
      "tob_Omon                sea_water_potential_temperature_at_sea_floor\n",
      "tosga_Omon              sea_surface_temperature\n",
      "tossq_Omon              square_of_sea_surface_temperature\n",
      "volo_Omon               sea_water_volume\n",
      "wfcorr_Omon             water_flux_correction\n",
      "wfo_Omon                water_flux_into_sea_water\n",
      "wo_Omon                 upward_sea_water_velocity\n",
      "zfullo_Omon             depth_below_geoid\n",
      "zossq_Omon              square_of_sea_surface_height_above_geoid\n",
      "zostoga_Omon            global_average_thermosteric_sea_level_change\n",
      "cdnc_Primmon            number_concentration_of_cloud_liquid_water_particles_in_air\n",
      "clwvic_Primmon          atmosphere_convective_cloud_condensed_water_content\n",
      "cod_Primmon             atmosphere_optical_thickness_due_to_cloud\n",
      "lwp_Primmon             atmosphere_cloud_liquid_water_content\n",
      "ua_PrimmonZ             eastward_wind\n",
      "va_PrimmonZ             northward_wind\n",
      "vstarbar_PrimmonZ       northward_transformed_eulerian_mean_air_velocity\n",
      "wstarbar_PrimmonZ       \n",
      "xnonoroggwdparam_PrimmonZ \n",
      "opottemptend_PrimOmon   tendency_of_sea_water_potential_temperature_expressed_as_heat_content\n",
      "somint_PrimOmon         integral_wrt_depth_of_product_of_sea_water_density_and_prognostic_salinity\n",
      "tomint_PrimOmon         integral_wrt_depth_of_product_of_sea_water_density_and_prognostic_temperature\n",
      "u2o_PrimOmon            square_of_sea_water_x_velocity\n",
      "v2o_PrimOmon            square_of_sea_water_y_velocity\n",
      "w2o_PrimOmon            square_of_sea_water_upward_velocity\n",
      "wso_PrimOmon            product_of_upward_sea_water_velocity_and_salinity\n",
      "wto_PrimOmon            product_of_upward_sea_water_velocity_and_salinity\n",
      "siage_SImon             age_of_sea_ice\n",
      "sialb_SImon             sea_ice_albedo\n",
      "siareaacrossline_SImon  sea_ice_area_transport_across_line\n",
      "siarean_SImon           sea_ice_area\n",
      "siareas_SImon           sea_ice_area\n",
      "sicompstren_SImon       compressive_strength_of_sea_ice\n",
      "siconca_SImon           sea_ice_area_fraction\n",
      "sidconcdyn_SImon        tendency_of_sea_ice_area_fraction_due_to_dynamics\n",
      "sidconcth_SImon         tendency_of_sea_ice_area_fraction_due_to_thermodynamics\n",
      "sidivvel_SImon          divergence_of_sea_ice_velocity\n",
      "sidmassdyn_SImon        tendency_of_sea_ice_amount_due_to_dynamics\n",
      "sidmassevapsubl_SImon   water_evaporation_flux\n",
      "sidmassgrowthbot_SImon  tendency_of_sea_ice_amount_due_to_congelation_ice_accumulation\n",
      "sidmassgrowthwat_SImon  tendency_of_sea_ice_amount_due_to_freezing_in_open_water\n",
      "sidmasslat_SImon        tendency_of_sea_ice_amount_due_to_lateral_melting\n",
      "sidmassmeltbot_SImon    tendency_of_sea_ice_amount_due_to_basal_melting\n",
      "sidmassmelttop_SImon    tendency_of_sea_ice_amount_due_to_surface_melting\n",
      "sidmasssi_SImon         tendency_of_sea_ice_amount_due_to_snow_conversion\n",
      "sidmassth_SImon         tendency_of_sea_ice_amount_due_to_thermodynamics\n",
      "sidmasstranx_SImon      sea_ice_x_transport\n",
      "sidmasstrany_SImon      sea_ice_y_transport\n",
      "siextentn_SImon         sea_ice_extent\n",
      "siextents_SImon         sea_ice_extent\n",
      "sifb_SImon              sea_ice_freeboard\n",
      "siflcondbot_SImon       conductive_heat_flux_at_sea_ice_bottom\n",
      "siflcondtop_SImon       conductive_heat_flux_at_sea_ice_surface\n",
      "siflfwbot_SImon         freshwater_flux_from_ice\n",
      "siflfwdrain_SImon       freshwater_flux_from_ice_surface\n",
      "sifllatstop_SImon       surface_upward_latent_heat_flux\n",
      "sifllwdtop_SImon        surface_downwelling_longwave_flux_in_air\n",
      "sifllwutop_SImon        surface_upwelling_longwave_flux_in_air\n",
      "siflsaltbot_SImon       salt_flux_from_ice\n",
      "siflsenstop_SImon       surface_upward_sensible_heat_flux\n",
      "siflsensupbot_SImon     ice_ocean_heat_flux\n",
      "siflswdbot_SImon        bottom_downwelling_shortwave_flux_into_ocean\n",
      "siflswdtop_SImon        surface_downwelling_shortwave_flux_in_air\n",
      "siflswutop_SImon        surface_upwelling_shortwave_flux_in_air\n",
      "sihc_SImon              integral_of_sea_ice_temperature_wrt_depth_expressed_as_heat_content\n",
      "simass_SImon            sea_ice_amount\n",
      "simassacrossline_SImon  sea_ice_transport_across_line\n",
      "sipr_SImon              rainfall_flux\n",
      "sisali_SImon            sea_ice_salinity\n",
      "sisaltmass_SImon        sea_ice_salt_mass\n",
      "sishevel_SImon          maximum_shear_of_sea_ice_velocity\n",
      "sisnconc_SImon          surface_snow_area_fraction\n",
      "sisnhc_SImon            thermal_energy_content_of_surface_snow\n",
      "sisnmass_SImon          liquid_water_content_of_surface_snow\n",
      "sisnthick_SImon         surface_snow_thickness\n",
      "sistrxdtop_SImon        surface_downward_x_stress\n",
      "sistrxubot_SImon        sea_ice_base_upward_x_stress\n",
      "sistrydtop_SImon        surface_downward_y_stress\n",
      "sistryubot_SImon        downward_y_stress_at_sea_ice_base\n",
      "sitempbot_SImon         sea_ice_bottom_temperature\n",
      "sitempsnic_SImon        sea_ice_surface_temperature\n",
      "sitemptop_SImon         sea_ice_surface_temperature\n",
      "sivoln_SImon            sea_ice_volume\n",
      "sivols_SImon            sea_ice_volume\n",
      "sndmassdyn_SImon        tendency_of_snow_mass_due_to_sea_ice_dynamics\n",
      "sndmassmelt_SImon       surface_snow_melt_flux\n",
      "sndmasssi_SImon         tendency_of_surface_snow_amount_due_to_conversion_of_snow_to_sea_ice\n",
      "sndmasssnf_SImon        snowfall_flux\n",
      "sndmasssubl_SImon       surface_snow_sublimation_flux\n",
      "snmassacrossline_SImon  snow_mass_transport_across_line\n"
     ]
    }
   ],
   "source": [
    "drs = DataRequest.objects.filter(datafile__isnull=False).distinct()\n",
    "vrs_ids = [vrs_id[0] for vrs_id in set(list(drs.values_list('variable_request')))]\n",
    "vrs = VariableRequest.objects.filter(id__in=vrs_ids)\n",
    "for vr in vrs.distinct().order_by('frequency', 'table_name', 'cmor_name'):\n",
    "    if vr not in var_reqs_ordered:\n",
    "        print('{:<23} {}'.format(vr.cmor_name + '_' + vr.table_name, vr.standard_name))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.8"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}