UpstashRedisCache Support for time-to-live

[Zamoca42]

Checked

• I searched existing ideas and did not find a similar one
• I added a very descriptive title
• I've clearly described the feature request and motivation for it

Feature request

Add support for setting a time-to-live (TTL) value in UpstashRedisCache for the JavaScript implementation. This feature will allow users to define an expiration time for cached items, aligning the functionality with the Python version of UpstashRedisCache.

Motivation

Currently, the Python version of UpstashRedisCache supports the ttl (Time To Live) feature, allowing users to specify expiration times for cached items. However, this functionality is not available in the JavaScript version.

Proposal (If applicable)

I propose adding ttl support to the JavaScript implementation by modifying the set method in UpstashRedisCache as follows:

// class UpstashRedisCache
  public async update(prompt: string, llmKey: string, value: Generation[]) {
    for (let i = 0; i < value.length; i += 1) {
      const key = getCacheKey(prompt, llmKey, String(i));
      const serializedValue = JSON.stringify(serializeGeneration(value[i]));

      if (this.ttl) {
        await this.redisClient.set(key, serializedValue, { ex: this.ttl });
      } else {
        await this.redisClient.set(key, serializedValue);
      }
    }
  }

If no one else is already working on this, I would like to start implementing this feature. Please let me know if this sounds good or if there are any additional considerations I should keep in mind. 😊