Skip to Main Content
IBM Security Ideas Portal

Shape the future of IBM Security

We invite you to shape the future of IBM, including the product roadmap, by submitting enhancement ideas that matter to you the most.

Here's how it works:

Post your ideas

Start by posting ideas and requests to enhance a product or service. Take a look at ideas others have posted and vote for them if they matter to you,

  1. Post an idea

  2. Vote for ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Help IBM prioritize your ideas and requests

The IBM team may need your help to refine the ideas so they may ask for more information or feedback. The offering manager team will then decide if they can begin working on your idea. If they can start during the next development cycle, they will put the idea on the priority list. Each team at IBM works on a different schedule, where some ideas can be implemented right away, others may be placed on a different schedule.


Receive notification on the decision

Some ideas can be implemented at IBM, while others may not fit within the development plans for the product. In either case, the team will let you know as soon as possible. In some cases, we may be able to find alternatives for ideas which cannot be implemented in a reasonable time.


Post an Idea

To post a new idea - click on the "Add a new idea" button and where asked select the appropriate category this idea relates to. Provide requested information to allow us to get a better understanding of your request.


"Missing" Security Products?

If you cannot find the IBM Security product you are looking for then it is probably located in the IBM Security Private Ideas Portal. Check that site to open an idea.


Idea visibility

All ideas submitted via this portal are visible to all other portal users, though personal information fields remain hidden. If you would rather have your idea visible to only you and IBM then use the IBM Security Private Ideas Portal instead.


Please note: The purpose of the Ideas Portal is to tap the creativity of the IBM Security community so that we can enhance our products for everyone! If you need to report a defect or get help, please use our normal support channel. Click here to open a support ticket.


Want to see all of your IBM ideas in one place? Find them at ideas.ibm.com

Status Future consideration
Created by Guest
Created on May 24, 2022

Universal Cloud REST API protocol does not have an option for processing HTTP streaming data

HTTP streaming is a push-style data transfer technique that allows a web server to continuously send data to a client over a single HTTP connection that remains open indefinitely

This enables clients to consume events in near-real-time and there is no need for repeated polling of the API

For Cloud back end, this becomes an advantage to control the incoming HTTP connection rate (which otherwise is a huge overhead)

Current Universal Cloud Rest API functionality: Right now, there is no option to iterate over the response data, and then process the events present in the data received in each iteration

Requested Universal Cloud Rest API functionality: An ability to process HTTP streaming data wherein client can iterate over response chunks which in turn contains events


Example reference on streams response processing in Python for processing HTTP streams response

set "stream=true" and "iter_lines()" which is a python HTTP response object function allows iterating over lines, below is a sample:

        import json

import time
import sys
import requests

r = requests.get('https://httpbin.org/stream/20', stream=True)

if r.encoding is None:
r.encoding = 'utf-8'


for line in r.iter_lines(chunk_size=8 * 1024 * 1024, decode_unicode=True):
if line:
print(line)

Our requirement is on similar lines where each line is a JSON which can easily reach 5mb

Note:

chunk_size is the number of bytes it should read into memory.

Value set to 8mb is for representational purposes only, tuning would be needed for a good throughput

iter_lines/iter_contents helps to avoid reading the response content at once into memory of large responses


Symantec API Reference: https://apidocs.securitycloud.symantec.com/#/doc?id=ses_event_stream_export

The termination of HTTP connection is enabled through two parameters in the HTTP request payload connectionTimeout=60 minutes AND responseTimeout=10 seconds


  • Admin
    Gaurav Sharma
    Jun 22, 2022

    Hello,


    Thank you for taking the time to provide your ideas to IBM. Your request may not be delivered within the release currently under development, but the theme aligns with our current roadmap and, as such, is being tagged for future consideration. IBM may consider and evaluate any community feedback for your request through activities such as voting and we may reach out to you about this request to discuss additional details with you in the future.


    We truly value our relationship with you and appreciate your willingness to share details about your experience, your recommendations, and ideas.


    If you have any additional feedback or thoughts, or if there is anything else I can do, please do not hesitate to reply to this message to continue the conversation.


    Please note: IBM's statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM's sole discretion.