mpr.materials.elasticity.search() does not return all results

[fxcoudert]

Python version

Python 3.10.14

Pymatgen version

2024.8.9

Operating system version

macOS 14

Current behavior

data = mpr.materials.elasticity.search(fields=["material_id", "formula_pretty", "structure", "elastic_tensor"])
print("Number of materials retrieved:", len(data))

You can see that it expects 12392 results (in line with what the website shows, roughly) but only downloads 10733.

Expected Behavior

The search should download all available records.

Minimal example

from pymatgen.ext.matproj import MPRester
mpr = MPRester(mpapikey)
data = mpr.materials.elasticity.search(fields=["material_id", "formula_pretty", "structure", "elastic_tensor"])
print("Number of materials retrieved:", len(data))

[janosh]

moving this to the api repo since it's not an issue with pymatgen

[tschaume]

Thanks for reporting this @fxcoudert. Good catch! I can reproduce the issue and am looking into it.

[tschaume]

@fxcoudert 1659 out of 12392 entries are deprecated and the API client skips them for empty queries while including them in the count for the progress bar. If you add a query on poisson_ratio for instance, deprecated entries are included and would need to be post-filtered out, though. @munrojm might remember why we went this route.