Skip to content

Use shared Redis cache for jhu data #306

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Kilo59 merged 24 commits into from
Apr 30, 2020
Merged

Use shared Redis cache for jhu data #306

Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
a93a996
import datetime as dt
Kilo59 Apr 26, 2020
f2b54cc
add & log a data_id string for each cache
Kilo59 Apr 26, 2020
27a0f1e
dev mode should run with debug log level
Kilo59 Apr 26, 2020
cb4bbc0
log missing country code at sub debug level
Kilo59 Apr 26, 2020
a02af8a
rollback datetime import change
Kilo59 Apr 26, 2020
c1e97e1
Merge pull request #17 from Kilo59/redis
Kilo59 Apr 26, 2020
c6a6bae
rollback datetime import change
Kilo59 Apr 26, 2020
acbbcfe
use pydantic for config managment
Kilo59 Apr 26, 2020
f223325
add redis config settings
Kilo59 Apr 26, 2020
3923345
add aiocache with redis support
Kilo59 Apr 27, 2020
2bed4b3
add todos, stubs, prototypes
Kilo59 Apr 27, 2020
609345b
use memory cache
Kilo59 Apr 27, 2020
de1cda3
use shared cache for jhu data
Kilo59 Apr 27, 2020
c97476e
cleanup
Kilo59 Apr 27, 2020
ff70de3
Merge pull request #18 from Kilo59/redis
Kilo59 Apr 27, 2020
703153b
fix url type
Kilo59 Apr 28, 2020
2c146eb
add aiofiles
Kilo59 Apr 29, 2020
da17412
add async save/read
Kilo59 Apr 29, 2020
bd03939
update tests
Kilo59 Apr 29, 2020
d0679c2
Merge pull request #19 from Kilo59/aio-files
Kilo59 Apr 29, 2020
d69985f
Merge branch 'master' into master
Kilo59 Apr 29, 2020
4a7cfe2
update dependencies
Kilo59 Apr 30, 2020
b429328
change pylint config to pyproject.toml
Kilo59 Apr 30, 2020
bb2ecbd
cache jhu data (locally) for 30 minutes
Kilo59 Apr 30, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
cache jhu data (locally) for 30 minutes
  • Loading branch information
@Kilo59
Kilo59 committed Apr 30, 2020
commit bb2ecbd6a929fbd85310abd29b18a04a4b9ae1db
4 changes: 2 additions & 2 deletions app/services/location/jhu.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ async def get(self, loc_id): # pylint: disable=arguments-differ
)


@cached(cache=TTLCache(maxsize=1024, ttl=3600))
@cached(cache=TTLCache(maxsize=1024, ttl=1800))
async def get_category(category):
"""
Retrieves the data for the provided category. The data is cached for 1 hour.
Expand Down Expand Up @@ -129,7 +129,7 @@ async def get_category(category):
return results


@cached(cache=TTLCache(maxsize=1024, ttl=3600))
@cached(cache=TTLCache(maxsize=1024, ttl=1800))
async def get_locations():
"""
Retrieves the locations from the categories. The locations are cached for 1 hour.
Expand Down