Alex Leventer

This is the third post in our new Astra DB Crypto Blog Series! We&rsquo;ll introduce you to IPFS gateways and show you how to run your own to store NFT metadata on AWS. Check <a href="https://www.datastax.com/blog/tracking-nft-transfers-using-astra-db-and-web3-js">Part 1</a> to learn how to load NFTs into Astra DB, and <a href="https://www.datastax.com/blog/pulling-real-time-ethereum-transactions-with-web3-js">Part 2</a> to get the 101 on pulling Ethereum transactions with Web3.js.
This week in our Crypto series, we&rsquo;re digging into IPFS gateways. In a nutshell, an <a href="https://docs.ipfs.io/concepts/what-is-ipfs/">IPFS (InterPlanetary File System)</a> is a distributed system for storing and accessing data. So, as part of the effort to <a href="https://www.datastax.com/blog/tracking-nft-transfers-using-astra-db-and-web3-js">store every NFT in existence in Astra DB</a>, we set up and ran our own IPFS gateway to distribute our NFT&rsquo;s metadata faster and at a much lower cost (since no servers are involved).
In this post, we&rsquo;ll walk you through the basics of IPFS gateways and walk you through running your own IPFS Gateway on AWS.
<h2>What is an IPFS Gateway?</h2>
Let&rsquo;s start with an introduction to an IPFS gateway. It&rsquo;s essentially a distributed file storage system that allows computers around the world to store and serve files, websites, applications, and data. Think of it as a giant peer-to-peer network. If you run IPFS on your computer and upload a file to the IPFS network, anyone else in the world also running IPFS can view and download that file.&nbsp;
Naturally, IPFS gateways are heavily used in the Web3 world to store NFT metadata, such as name, image, description <a href="https://docs.opensea.io/docs/metadata-standards">and more</a>. Being distributed makes it particularly popular since having all that data shared on computers around the globe&mdash;rather than in one centralized location&mdash;makes data much easier to share, harder to hack or censor, and faster to retrieve. Plus, it makes data immutable, which means that once the data is pinned, it can&rsquo;t be changed.&nbsp;
As for running your own IPFS gateway, you can use an &ldquo;IPFS gateway as a service&rdquo; from companies like <a href="https://www.pinata.cloud/">Pinata</a> or <a href="https://ipfs.io/">IPFS.io</a>. Although keep in mind that these services are heavily rate-limited.
<h2>How to run your own IPFS Gateway</h2>
Now that you have a better understanding of what an IPFS gateway is, here&rsquo;s how to run one of your own. For this, we&rsquo;re going to use AWS as our cloud service provider.&nbsp;
<ul>
<li aria-level="1">Log into your AWS account</li>
</ul>
<ol>
<ol>
<li style="font-weight: 400;" aria-level="1">Create an EC2 Instance (we had the best results with a t2.large)</li>
<li style="font-weight: 400;" aria-level="1">Configure a security group with the following options:</li>
<ol>
<li style="font-weight: 400;" aria-level="2">Custom TCP: 8080</li>
<li style="font-weight: 400;" aria-level="2">Custom TCP: 4001-4002</li>
</ol>
<li style="font-weight: 400;" aria-level="1">SSH into your EC2 instance</li>
</ol>
</ol>
<ul>
<li aria-level="1">Install &ldquo;go-ipfs&rdquo;</li>
</ul>
<ol>
<ol>
<li style="font-weight: 400;" aria-level="2">Download the Linux binary: wget https://dist.ipfs.io/go-ipfs/v0.13.1/go-ipfs_v0.13.1_linux-amd64.tar.gz</li>
<li style="font-weight: 400;" aria-level="2">Unzip: tar -xvzf go-ipfs_v0.13.1_linux-amd64.tar.gz</li>
<li style="font-weight: 400;" aria-level="2">Navigate to the correct directory: cd go-ipfs</li>
<li style="font-weight: 400;" aria-level="2">Run the install script: sudo bash install.sh</li>
<li style="font-weight: 400;" aria-level="2">Check that IPFS was installed correctly by running: ipfs --version</li>
</ol>
</ol>
You can pull instructions for the latest version of `go-ipfs` on the <a href="https://docs.ipfs.io/install/command-line/#official-distributions">IPFS website</a>.
<ul>
<li aria-level="1">Initialize the IPFS repository</li>
</ul>
<ol>
<ol>
<ol>
<li style="font-weight: 400;" aria-level="2">Create a directory: mkdir /home/ubuntu/data/ipfs</li>
<li style="font-weight: 400;" aria-level="2">Add the path to your Bash profile: echo 'export IPFS_PATH=/home/ubuntu/data/ipfs &gt;&gt; ~/.profile</li>
<li style="font-weight: 400;" aria-level="2">Reload your bash profile: source ~/.profile</li>
<li style="font-weight: 400;" aria-level="2">Initialize the IPFS repository: ipfs init --profile server</li>
<li style="font-weight: 400;" aria-level="2">Open the Gateway on port 8080: ipfs config Addresses.Gateway /ip4/0.0.0.0/tcp/8080</li>
</ol>
</ol>
</ol>
<ul>
<li aria-level="1">Set up an IPFS service</li>
</ul>
<ol>
<ol>
<li style="font-weight: 400;" aria-level="2">Create a file: sudo vim /lib/systemd/system/ipfs.service</li>
<li style="font-weight: 400;" aria-level="2">Add the following contents to the file: [Unit]</li>
</ol>
</ol>
Description=ipfs daemon
[Service]
ExecStart=/usr/local/bin/ipfs daemon --enable-gc
Restart=always
User=ubuntu
Group=ubuntu
Environment="IPFS_PATH=/home/ubuntu/data/ipfs"
[Install]
WantedBy=multi-user.target
<ol>
<li style="font-weight: 400;" aria-level="1">Save the file</li>
<li style="font-weight: 400;" aria-level="1">Restart the daemon: sudo systemctl daemon-reload</li>
<li style="font-weight: 400;" aria-level="1">Enable the service: sudo systemctl enable ipfs.service</li>
<li style="font-weight: 400;" aria-level="1">Start the service: sudo systemctl start ipfs</li>
<li style="font-weight: 400;" aria-level="1">Check the status: sudo systemctl status ipfs</li>
<li style="font-weight: 400;" aria-level="1">You can test that your gateway is working by plugging in the Public IPv4 DNS URL and then the hash of pinned content. Your final URL should look something like this: http://ec2-3433-234-236-66.compute-1.amazonaws.com/ipfs/bafybeiemgfsgj5fzn26x7fs27eeuuaa6yeevlsp45hrj3tu4xvhnpfs6l4</li>
</ol>
<h2>Wrapping up</h2>
Congratulations, you&rsquo;ve officially set up an IPFS gateway! If you have any questions about the instructions or get stuck at any point, leave us a comment below or shoot us an email at <a href="mailto:blockchain@datastax.com">blockchain@datastax.com</a>.&nbsp;
Follow <a href="https://datastax.medium.com/">DataStax on Medium</a> for exclusive posts on all things open source, including Pulsar, Cassandra, streaming, Kubernetes, and more. To join a buzzing community of developers from around the world and stay in the data loop, follow DataStaxDevs on <a href="https://twitter.com/DataStaxDevs">Twitter</a> and <a href="https://www.linkedin.com/showcase/datastaxdevs">LinkedIn</a>.
<h2>Resources</h2>
<ol>
<li style="font-weight: 400;" aria-level="1"><a href="https://www.datastax.com/blog/tracking-nft-transfers-using-astra-db-and-web3-js">Part 1: Tracking NFT Transfers using Astra DB and Web3.js</a>&nbsp;</li>
<li style="font-weight: 400;" aria-level="1"><a href="https://www.datastax.com/blog/pulling-real-time-ethereum-transactions-with-web3-js">Part 2: Pulling Real-Time Ethereum Transactions with Web3.js</a>&nbsp;</li>
<li style="font-weight: 400;" aria-level="1"><a href="https://ipfs.io/">IPFS website</a>&nbsp;</li>
<li style="font-weight: 400;" aria-level="1"><a href="https://docs.ipfs.io/install/command-line/#official-distributions">Command-line | IPFS Docs</a>&nbsp;</li>
</ol>

How to Make & Run a Public IPFS Gateway on AWS - Fast & Easy

Alex LeventerEcosystem

Share

Share

What is an IPFS Gateway?

How to run your own IPFS Gateway

Wrapping up

Resources

More Technology

Knowledge Graphs for RAG without a GraphDB

How Winweb Built its AI Assistant with DataStax Astra DB and LangChain

Vercel + Astra DB: Get Data into Your GenAI Apps Fast

Simplifying Agent Development with Astra DB Connector for Vertex AI Search

One-stop Data API for Production GenAI