How to call REST API an send HTTP GET and POST Request using cURL command in Linux? Example Tutorial

The curl or cURL command of Linux is a compelling and versatile command which allows you to send sophisticated HTTP requests right from your Linux command line window. You can use the cURL command to test your RESTful Web Services by sending GET and POST requests, doing authentication, saving a cookie in the file, etc. The curl command is, in fact, the go-to tool for many Java and Spring developers working in web applications and consuming data from the secured RESTful Web Services. Still, you can also use it to test your simple REST Web APIs without security. I have used it many times to check if our Web service is up or not, or is there any error while accessing those services.

You can also use this to write a shell script for automatically doing health-check for your environment. All you need to do is to schedule the shell script using the crontab command, and it will automatically send a request and report errors or success at a fixed time of day.

Here are some of the useful command-line options of the cURL command, which is extremely important for connecting and testing your RESTful Web Service:

[--digest] it's a digest authentication
[-u{username}:{password}] attaching username and password
[-X PUT] method="put"
[-H 'Expect: '] header = 'Expect: '
[-H 'Content-type: application/xml'] additional header

The syntax of the curl command is as follows:

$ curl --digest \
-u{username}:{password} \
-v \
-X PUT \
-H 'Expect: ' \
-H 'Content-type: application/xml' \
-d @- \
http://localhost:8080/SpringRestDemo/api/book/9783827321312 \
< data.xml 

Here, d is for data. The "-d@ -" option will instruct the curl command to send a POST request with the data it reads from standard input.

The '<' operator tells the shell to feed a file to stdin. 

You can make it simpler by doing -d @data.xml and not using standard input at all.

If you are new to Linux, I suggest you go through Learn Linux in 5 Days and Level Up Your Career course on Udemy to get a head-start and learn some fundamentals + essential Linux commands you will going to use every day. It's an awesome course and very affordable too. I bought in just $10 on Udemy's flash sale, which happens every now and then.

How to send HTTP request from the Linux command line using cURL command? 

Here is my list of some of the most useful examples of curl command, which I use in my day-to-day life to test RESTful web services from the command line. 

You can even use these to write scripts and run them from crontab to automatically test the availability of your RESTful API, very useful if you are supporting a production REST application.

1. How to test Authentication against REST API

Suppose the URL for login in your REST web service is http://localhost:8080/SpringRestDemo/j_spring_security_check then you can use the following curl command for performing login:

$ curl -i -X POST 
          -d j_username=user 
          -d j_password=password
             http://localhost:8080/SpringRestDemo/j_spring_security_check

This request will also return the Cookie, which will then be used by any subsequent request against the same REST Web Service.

Btw, I have used Spring security to protect our RESTful web service here, if you want to learn more about that, you can check Learn Spring Security: The Certification Class by Eugen Paraschiv of Baeldung.   It's one of the better courses to learn Spring Security, which provides a guided and code-focused tour of Spring Security.

2. Saving the Cookie in a file using the curl command

While authenticating against RESTful Web Service, If you want, you can also save the Cookie into a specific file using the curl command as shown below:

$ curl -i -X POST 
          -d j_username=user 
          -d j_password=password 
          -c /tmp/cookies.txt
           http://localhost:8080/SpringRestDemo/j_spring_security_check

This request will save the Cookie into /tmp/cookies.txt file.

You can also save the Cookie into your home directory if you like; it will be the same there as /tmp is generally accessible to everybody, and also it's frequently cleaned by Linux.

3. Attaching Header and Cookie into an HTTP request using curl

You can also attach HTTP headers using the curl command by using option --header for authentication and authorization purposes. You can even attach Cookie into your HTTP request using the -b command option as shown below:

$ curl -i --header "Accept:application/json" 
          -X GET 
          -b /tmp/cookies.txt
           http://localhost:8080/SpringRestDemo/j_spring_security_check

This request will attach the "Accept" header and earlier saved cookie from /tmp/cookies.txt file into your HTTP request. The response will look like below:

HTTP/1.1 200 OK
Server: Apache-Coyote/1.1
Content-Type: application/json;charset=UTF-8
Transfer-Encoding: chunked
Date: Tue, 06 Jun 2017 22:21:23 IST
[{"ISBN":9783827321312,"title":"Effective Java"}]

If you are not very familiar with HTTP but currently working on a project which has a RESTful web service, I strongly suggest you first go through the HTTP Fundamentals course at Pluralsight. It's a free course and gives you enough knowledge about HTTP to survive in your day job while working with HTTP and REST.

4. Accessing RESTful Web Service 

If your RESTful Web Service doesn't implement security, then you can access a resource using the curl command as shown below:

$ curl -i http://localhost:8080/SpringRestDemo/api/book/9783827321312

This will return the JSON representation of the book with ISBN 9783827321312, but if your REST API is secured e.g. by using http basic auth, then you will receive a 403 unauthorized response as shown below:

HTTP/1.1 401 Unauthorized
Server: Apache-Coyote/1.1
Set-Cookie: JSESSIONID=25A833C16B6530A007CFA3AECEE2216B; Path=/SpringRestDemo/; HttpOnly
WWW-Authenticate: Basic realm="Secure REST API"
Content-Type: text/html;charset=utf-8
Content-Length: 1028
Date: Tue, 06 Jun 2017 22:21:23 IST

If you test the same REST API using a browser, you will be prompted to enter username and password by the browser because it will use HTTP basic authentication, but curl won't do that. You need to specially provide its username and password, as shown in the next example. 

See RESTful Web Services, Java, Spring Boot, Spring MVC, and JPA course on Udemy to learn more about HTTP basic and digest authentication in REST, it's a free course, and you can finish it in a couple of hours.

5. Accessing Secure RESTful Web Service using username and password

You can use the --user command-line option of curl to send username and password along with HTTP request to access a secure REST web API as shown below:

$ curl -i --user username password 
          http://localhost:8080/SpringRestDemo/api/book/9783827321312

Now, you will receive an HTTP response with success code 200, along with a cookie. This is useful when your application is using a username and password stored in a database or flat file for login.

It can also be used in conjunction with LDAP-based authentication, as long as you just need to provide a username and password.

6. Enabling digest authentication using the curl command

If your REST API is secured using digest authentication, then you can use the --digest flag to enable HTTP digest authentication in the curl command as well.

$ curl --digest 
       --user username:password
        -i http://localhost:8080/SpringRestDemo/api/book/9783827

Btw, if you are curious about how to secure your API using digest authentication, well, you can use Spring security. It supports both HTTP basic and digest authentication. You can see Spring Security Core: Beginner to Guru course by John Thompson on Udemy for implementation details.

7. Setting more than one header in the curl command

If you want you can set more than one HTTP header in your HTTP request by using the -H command-line option twice using curl in UNIX, as shown below:

$ curl -H "Accept: application/json"
       -H 'If-None-Match: "12334dfsfsdffe004fsdfds36a6"'
       -i http://localhost:8080/SpringRestDemo

You can see that by using -H options, you can also use attache HTTP headers for your requests. This is a powerful feature to test advanced features of REST API from the Linux command line. 

If you want to learn more about the cURL command and other useful options, I suggest you pick a comprehensive Linux course like Learn Linux in 5 Days and Level Up Your Career on Udemy.

That's all about how to use the curl command to test RESTful Web Services. You can run these curl commands from the Linux command line window right from the server or by using Putty or Cygwin from your development machine. 

If you don't want to use the Linux command line, you can also use tools like Postman and some Chrome extensions to test your REST API.

Btw, the command line is not the only option to test REST APIs, you can also use tools like Postman, Soap UI, and RESTAssured for testing REST API and RESTful web services. 

I like Postman, and if you want to learn more about how to use Postman for REST API testing, then you can also check out Postman: Complete Guide to REST API Testing course on Udemy.

Other REST and Linux command tutorials you may like

• 10 Advanced Spring Boot Courses for Java Programmers (courses)
• How does the nslookup command work in UNIX? (answer)
• 10 examples of lsof command in Linux? (examples)
• 5 Books to learn RESTful Web Services  (list)
• When to use PUT or POST in REST? (answer)
• 10 Frequently asked RESTful Web Service Interview Questions (list)
• How to send mail with attachments from Linux? (mailx)
• 10 examples of Networking commands in Unix (nslookup)
• 5 Example of kill commands in Unix and Linux (example)
• How to find all files matching specific text in Linux (grep)
• How to use the netstat command to find which process is listening on a port? (example)
• Linux find + du + grep example (example)
• 10 Examples of chmod command in Linux (chmod)
• Top 5 Courses to learn Postman tool for REST API Testing (courses)

Thanks for reading this article, if you like this article, then please share it with your friends and colleagues. If you have any suggestions or feedback, then please drop a comment.

P. S. - If you are looking for some free online courses to start your Linux journey, you should check out my list of Free Linux Courses for Programmers, Web Developers, IT Professionals, and System Administrators.