Repository navigation
Getting pymongo.errors.ExecutionTimeout for using more than 1 instance of AsyncMinHashLSH #187
Description
I have a use case where i have to store min hash of (n) different categories of file and the query them.
For example if i have documents of category A and I want to store all of them in one db and then query at later point.
I am initializing this in a microservice as (fastapi) as follows
@app.on_event("startup")
async def startup_event():
LSHService.lsh_js, LSHService.lsh_css, LSHService.lsh_html, = await asyncio.gather(
*[
await AsyncMinHashLSH(
storage_config={
**_storage,
"basename": "category-a".encode(),
},
threshold=0.9,
num_perm=256,
),
await AsyncMinHashLSH(
storage_config={
**_storage,
"basename": "category-b".encode(),
},
threshold=0.9,
num_perm=256,
),
await AsyncMinHashLSH(
storage_config={
**_storage,
"basename": "category-b".encode(),
},
threshold=0.9,
num_perm=256,
),
]
)
If i initialize like this i get
Getting pymongo.errors.ExecutionTimeout Error
However If i just maintain 1 object then I dont get any error.
What can I do mitigate this?
Thanks in advance
Activity
ekzhu commentedon Jun 7, 2022
Not an expert in async. @aastafiev would you be able to take a look?
RonaldRegan69 commentedon Jun 13, 2022
any update over this?
aastafiev commentedon Jun 13, 2022