{"componentChunkName":"component---src-templates-tag-js","path":"/tags/http/","result":{"data":{"site":{"siteMetadata":{"title":"LoginRadius Blog"}},"allMarkdownRemark":{"totalCount":1,"edges":[{"node":{"fields":{"slug":"/engineering/tune-the-go-http-client-for-high-performance/"},"html":"

HTTP (hypertext transfer protocol) is a communication protocol that transfers data between client and server. HTTP requests are very essential to access resources from the same or remote server. In Golang, the net/http package comes with the default settings that we need to adjust according to our high-performance requirement.

\n

For setting up HTTP clients for making requests, most programming languages have different frameworks in place. We will take a hands-on approach in the coming sections to explore how HTTP requests can be made in Golang or Go, as I will refer to the language for the rest of the post.

\n

While working on the Golang projects, I realized that improper configuration of HTTP might crash your server anytime.

\n

In the time when I was working with HTTP Client, I Observed some problems and their solutions, listed below:

\n

Problem:1 Default Http Client

\n

The HTTP client does not contain the request timeout setting by default.\nIf you are using http.Get(URL) or &Client{} that uses the http.DefaultClient. DefaultClient has not timeout setting; it comes with no timeout

\n

Suppose the Rest API where you are making the request is broken, not sending the response back that keeps the connection open. More requests came, and open connection count will increase, Increasing server resources utilization, resulting in crashing your server when resource limits are reached.

\n

Solution: Don't use the default HTTP client, always specify the timeout in http.Client according to your use case

\n
var httpClient = &http.Client{\n  Timeout: time.Second * 10,\n}
\n

For the Rest API, it is recommended that timeout should not more than 10 seconds.\nIf the Requested resource is not responded to in 10 seconds, the HTTP connection will be canceled with net/http: request canceled (Client.Timeout exceeded ...) error.

\n

Problem:2 Default Http Transport

\n

By default, the Golang Http client performs the connection pooling. When the request completes, that connection remains open until the idle connection timeout (default is 90 seconds). If another request came, that uses the same established connection instead of creating a new connection, after the idle connection time, the connection will return to the pool.

\n

Using the connection pooling will keep less connection open and more requests will be served with minimal server resources.

\n

When we not defined transport in the http.Client, it uses the default transport Go HTTP Transport

\n

Default configuration of the HTTP Transport,

\n
var DefaultTransport RoundTripper = &Transport{\n\t...\n\tMaxIdleConns:          100,\n\tIdleConnTimeout:       90 * time.Second,\n\t...\n}\n\nconst DefaultMaxIdleConnsPerHost = 2
\n

MaxIdleConns is the connection pool size, and this is the maximum connection that can be open; its default value is 100 connections.

\n

There is problem with the default setting DefaultMaxIdleConnsPerHost with value of 2 connection,\nDefaultMaxIdleConnsPerHost is the number of connection can be allowed to open per host basic.\nMeans for any particular host out of 100 connection from the connection pool only two connection will be allocated to that host.

\n

With the more request came, it will process only two requests; other requests will wait for the connection to communicate with the host server and go in the TIME_WAIT state. As more request came, increase the connection to the TIME_WAIT state and increase the server resource utilization; at the limit, the server will crash.

\n

Solution: Don't use Default Transport and increase MaxIdleConnsPerHost

\n
t := http.DefaultTransport.(*http.Transport).Clone()\nt.MaxIdleConns = 100\nt.MaxConnsPerHost = 100\nt.MaxIdleConnsPerHost = 100\n\t\nhttpClient = &http.Client{\n  Timeout:   10 * time.Second,\n  Transport: t,\n}
\n

By increasing connection per host and the total number of idle connection, this will increase the performance and serve more request with minimal server resources.

\n

Connection pool size and connection per host count can be increased as per server resources and requirements.

\n

Conclusion

\n

In this article, we discussed the problems around the 'net/http' client default configurations. By changing some of the default settings of HTTP Client, we can achieve a High-performance HTTP client for production use. If you want to learn more about http, here is an interesting post on HTTP security headers If you like what you read, share your thoughts in the comment section.

\n","frontmatter":{"date":"January 12, 2021","updated_date":null,"title":"How to Use the HTTP Client in GO To Enhance Performance","tags":["Golang","HTTP","Performance"],"coverImage":{"childImageSharp":{"fluid":{"aspectRatio":1.7699115044247788,"src":"/static/68276d4b4277ad09e329598038e91917/14b42/index.jpg","srcSet":"/static/68276d4b4277ad09e329598038e91917/f836f/index.jpg 200w,\n/static/68276d4b4277ad09e329598038e91917/2244e/index.jpg 400w,\n/static/68276d4b4277ad09e329598038e91917/14b42/index.jpg 800w,\n/static/68276d4b4277ad09e329598038e91917/47498/index.jpg 1200w,\n/static/68276d4b4277ad09e329598038e91917/ec6c5/index.jpg 1280w","sizes":"(max-width: 800px) 100vw, 800px"}}},"author":{"id":"Mayank Agarwal","github":"mayankagrwal","avatar":null}}}}]}},"pageContext":{"tag":"HTTP"}},"staticQueryHashes":["1171199041","1384082988","2100481360","23180105","528864852"]}