feature: dynamic endpoints based on pre-defined sql queries

[nitisht]

Implement an endpoint /api/v1/query/dynamic with payload

{
    "query":"Select * from {{stream_name}} order by p_timestamp limit 10",
    "cache-duration":"5m"
}

This API will respond with a unique URL will serves plain JSON response to this query. The data will be refreshed every 5m as configured in the payload.

We'd love to get feedback from the community if they think this is useful. Please add a 👍🏽 in the issue to show your interest.

[sudharsangs]

@nitisht can I pick this issue?

[nitisht]

hey @sudharsangs you can, for sure

[mrchypark]

any update with this issue?

[nitisht]

Right now there are no plans to work on this @mrchypark . Is this something you think will be useful to you?

[nitisht]

We can leverage Datafusion CREATE_FUNC https://github.com/apache/arrow-datafusion/blob/main/datafusion-examples/examples/function_factory.rs

[mrchypark]

@nitisht Thank you for the information. I had initially understood this feature as something similar to a materialized view. I thought it would be a useful feature if it could proactively perform calculations and cache the results in advance, although it might also execute upon request depending on the configuration. I appreciate you sharing the details, and I will definitely look into the aspects you mentioned. Thank you for your help and insights.

[nitisht]

/bounty 300

[ssddOnTop]

/attempt #370

Algora profile	Completed bounties	Tech	Active attempts	Options
@ssddOnTop	76 bounties from 1 project	Rust, Java, C & more		Cancel attempt

[TomBebb]

/attempt #370

Options

• Cancel my attempt