-
Notifications
You must be signed in to change notification settings - Fork 2.7k
awss3exporter support mapping attributes #37858
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comments
Pinging code owners:
See Adding Labels via Comments if you do not have permissions to add labels yourself. |
I would be open to attempting this work provided it's something that would be accepted. |
any updates if this will be worked on? this is a functionality that we also need so that the storage of relevant data should be segregated depending on tenant a functionality similar to splunk exporter is actually good.. |
I'm hopeful to get some feedback from others as well as the maintainers here to see if it's something worth bringing into this exporter such that it has some amount of continued support 😄 |
I am open to adding this support, but I think you will need to stick around and become a codeowner to continue to maintain it. If that sounds good to you, please let me know and I will assign the issue to you. |
Your coworker is a tad too light in contributions. You also cannot be a sponsor ; you need approver or maintainer role to sponsor.
|
Ah apologies, I'd thought that as an approver in contrib, I'd met that requirement. I'm happy to own this in that case and can bring him on to lend a hand if that's okay with you. |
Hi all, I am glad to work on this feature and will be completing the PR recently. Kindly let me know if you have any thoughts, Thank you! |
I'll also be here and will submit a PR to be a codeowner tomorrow. |
…butes (open-telemetry#39634) <!--Ex. Fixing a bug - Describe the bug and how this fixes the issue. Ex. Adding a feature - Explain what this achieves.--> #### Description Introduced the `resource_attrs_to_s3/s3_prefix` configuration field to enable mapping the S3 bucket prefix to an OpenTelemetry resource attribute. When this field is set, the S3 prefix is determined by the specified resource attribute, with `s3uploader/s3_prefix` used as a fallback if the attribute is missing or empty. <!-- Issue number (e.g. open-telemetry#1234) or full URL to issue, if applicable. --> #### Link to tracking issue Fixes open-telemetry#37858 <!--Describe what testing was performed and which tests were added.--> #### Testing - Added unit tests to verify the functionality of the related code changes - Built the OpenTelemetry Collector locally to ensure the component behaves as intended <!--Describe the documentation added.--> #### Documentation Updated the README to document the new configuration field: - Described its impact on the component’s behavior - Clarified how it interacts with the `s3uploader/s3_prefix` setting - Included an example demonstrating how to use it <!--Please delete paragraphs that you did not use before submitting.-->
Component(s)
exporter/awss3
Is your feature request related to a problem? Please describe.
When mapping logs to an S3 bucket for cold storage, every tenant / prefix needs to be associated with a unique exporter. This leads to a problem trying to use the routing exporter to route logs from centralized collectors.
Describe the solution you'd like
It would be fantastic if the AWS S3 exporter would support similar functionality as the splunk hec exporter allowing to map configuration values from resource attributes. This way incoming logs can be automatically routed based on incoming attributes. Namely the
prefix
attribute to start.Describe alternatives you've considered
We've considered alternatives in order to route to unique exporters, but it would become too troublesome to manage over time.
Additional context
No response
The text was updated successfully, but these errors were encountered: