Madhavan Sridharan

<h2>It wasn&rsquo;t enough to have &ldquo;the cloud,&rdquo; but now we have fog?</h2>
<p>What&rsquo;s next&mdash;hail?</p>
<p>The term may sound a little odd and conjure up images of distant lighthouses in faraway lands, but &ldquo;fog computing&rdquo;&mdash;a term created by Cisco in 2012&mdash;is actually a &ldquo;thing&rdquo; and is becoming more and more of a thing every day as the Internet of Things (IoT) grows.</p>
<p>451 Research predicts that fog computing has the potential to reach <a href="https://www.openfogconsortium.org/wp-content/uploads/451-Research-report-on-5-year-Market-Sizing-of-Fog-Oct-2017.pdf">more</a> <a href="https://www.openfogconsortium.org/wp-content/uploads/451-Research-report-on-5-year-Market-Sizing-of-Fog-Oct-2017.pdf">than</a><a href="https://www.openfogconsortium.org/wp-content/uploads/451-Research-report-on-5-year-Market-Sizing-of-Fog-Oct-2017.pdf"> $18 </a><a href="https://www.openfogconsortium.org/wp-content/uploads/451-Research-report-on-5-year-Market-Sizing-of-Fog-Oct-2017.pdf">billion</a> worldwide by 2022, and Statista predicts the number of connected devices worldwide to <a href="https://www.statista.com/statistics/471264/iot-number-of-connected-devices-worldwide/">grow</a> <a href="https://www.statista.com/statistics/471264/iot-number-of-connected-devices-worldwide/">to</a> <a href="https://www.statista.com/statistics/471264/iot-number-of-connected-devices-worldwide/">over</a><a href="https://www.statista.com/statistics/471264/iot-number-of-connected-devices-worldwide/"> 75 </a><a href="https://www.statista.com/statistics/471264/iot-number-of-connected-devices-worldwide/">billion</a> by 2025.</p>
<p>That&rsquo;s a huge market, so obviously we are talking about something important.</p>
<p>But first&mdash;let&rsquo;s make sure we&rsquo;re clear on what &ldquo;fog computing&rdquo; is.</p>
<h2>What is fog computing?</h2>
<p>Also referred to as &ldquo;fogging&rdquo;, fog computing essentially means extending computing to the edge of an enterprise&rsquo;s network rather than hosting and working from a centralized cloud. This facilitates the local processing of data in smart devices and smooths the operation of compute, storage, and networking services between end devices and cloud computing data centers.</p>
<p>Fog computing supports <a href="https://www.datastax.com/internet-of-things">IoT</a>, <a href="https://www.datastax.com/2019/02/how-5g-will-impact-your-data-management-strategy">5</a><a href="https://www.datastax.com/2019/02/how-5g-will-impact-your-data-management-strategy">G</a>, <a href="https://www.datastax.com/2018/09/ai-and-data-management-the-4-facts-you-should-know">artificial</a> <a href="https://www.datastax.com/2018/09/ai-and-data-management-the-4-facts-you-should-know">intelligence</a><a href="https://www.datastax.com/2018/09/ai-and-data-management-the-4-facts-you-should-know"> (</a><a href="https://www.datastax.com/2018/09/ai-and-data-management-the-4-facts-you-should-know">AI</a><a href="https://www.datastax.com/2018/09/ai-and-data-management-the-4-facts-you-should-know">)</a>, and other applications that require ultra-low latency, high network bandwidth, resource constraints, and added security.</p>
<h2>Are fog computing and edge computing the same thing?</h2>
<p>No. Fog computing always uses edge computing, but not the other way around. Fog is a system-level architecture, providing tools for distributing, orchestrating, managing, and securing resources and services across networks and between devices that reside at the edge.</p>
<p>Edge computing architectures place servers, applications, or small clouds at the edge. Fog computing has a hierarchical and flat architecture with several layers forming a network, while edge computing relies on separate nodes that do not form a network.</p>
<p>Fog computing has extensive peer-to-peer interconnect capability between nodes, where each edge runs its nodes in silos, requiring data transport back through the cloud for peer-to-peer traffic. Finally, fog computing is inclusive of cloud, while edge computing excludes the cloud.</p>
<h2>Why is fog computing needed?</h2>
<p>The major cloud platforms rarely experience downtime, but it still happens every now and again; and when it does, it spells big problems and big losses.</p>
<p>In May 2018, for example, <a href="https://www.theregister.co.uk/2018/06/01/aws_outage/">AWS</a> <a href="https://www.theregister.co.uk/2018/06/01/aws_outage/">was</a> <a href="https://www.theregister.co.uk/2018/06/01/aws_outage/">knocked</a> <a href="https://www.theregister.co.uk/2018/06/01/aws_outage/">offline</a> for 30 minutes. That might not seem like a lot of time. But let&rsquo;s say you&rsquo;re a large enterprise with 50,000 employees. If none of them are able to access the data they need to do their jobs for 30 minutes, that&rsquo;s 25,000 hours&mdash;or 3,125 eight-hour work days&mdash;the enterprise loses.</p>
<p>Similarly, in November 2018, <a href="https://www.zdnet.com/article/microsoft-azure-office-365-users-hit-by-multi-factor-authentication-issue/">Microsoft</a> <a href="https://www.zdnet.com/article/microsoft-azure-office-365-users-hit-by-multi-factor-authentication-issue/">Azure</a> <a href="https://www.zdnet.com/article/microsoft-azure-office-365-users-hit-by-multi-factor-authentication-issue/">was</a> <a href="https://www.zdnet.com/article/microsoft-azure-office-365-users-hit-by-multi-factor-authentication-issue/">down</a>&mdash;not just once, but twice&mdash;due to multi-factor authentication issues affecting a variety of customers&rsquo; applications.</p>
<p>Latency, security and privacy, unreliability, etc.,&mdash;all of the above are genuine reasons for concern as the number of connected devices increases and puts overwhelming stress on the big cloud providers&rsquo; networks. Real-time processing, a priority for IoT, also becomes very difficult. Without question, these difficulties have led to the Internet of Things requiring a new platform other than the cloud to function optimally&mdash;a new infrastructure that can handle all IoT transactions without any unnecessary risks.</p>
<p>Fog computing has emerged as the solution.</p>
<h2>How does fog computing work?</h2>
<p>Depending on your background, fog computing is probably not as complicated as it may sound.</p>
<p>Developers either port or write IoT applications for fog nodes at the network edge. The fog nodes closest to the network edge ingest the data from IoT devices. Then&mdash;and this is crucial&mdash;the fog IoT application directs different types of data to the optimal place for analysis.</p>
<ul>
<li>For most cases, time-sensitive data is analyzed on the fog node closest to the things generating the data.</li>
<li>A centralized aggregation cluster/node is used for analysis of data that can wait seconds or minutes and then an action is performed.</li>
<li>For historical analysis and storage purpose, data that is less time sensitive is sent to the cloud. An example here would be each of the fog nodes sending periodic summaries of data to the cloud for historical or big data analysis.</li>
</ul>
<p><img title="client devices, fog nodes, hybrid cloud" src="https://www.datastax.com/sites/default/files/content/blog/2019-08/20190409_corpblog_fog_computing.jpg" alt="" /> Figure 1. WM-FOG software stack. The top layer is the application layer, where user applications reside. The next layer is the workflow layer, where workflow instances reside. Under the workflow layer is the system layer, where the system components reside. The bottom layer is the entity layer, where the system entities (client devices, fog nodes, and the cloud) reside. Reference: <a href="http://www.cs.wm.edu/">http</a><a href="http://www.cs.wm.edu/">://</a><a href="http://www.cs.wm.edu/">www</a><a href="http://www.cs.wm.edu/">.</a><a href="http://www.cs.wm.edu/">cs</a><a href="http://www.cs.wm.edu/">.</a><a href="http://www.cs.wm.edu/">wm</a><a href="http://www.cs.wm.edu/">.</a><a href="http://www.cs.wm.edu/">edu</a></p>
<h2>How does the fog interact with the cloud?</h2>
<p>The fog and cloud do a dance that allows each to perform optimally for the IoT use case. The main difference between fog computing and cloud computing is that cloud is a centralized system, while fog is a distributed decentralized infrastructure.</p>
<h3>Fog nodes:</h3>
<ul>
<li>Receive feeds from IoT devices using any protocol, in real time.</li>
<li>Run IoT-enabled applications for real-time control and analytics, with millisecond response time.</li>
<li>Provide transient storage, often 1&ndash;2 hours.</li>
<li>Send periodic data summaries to the cloud.</li>
</ul>
<h3>The cloud platform:</h3>
<ul>
<li>Receives and aggregates data summaries from many fog nodes.</li>
<li>Performs analysis on the IoT data and data from other sources to gain business insight.</li>
<li>Can send new application rules to the fog nodes based on these insights.</li>
</ul>
<h2>When do I need to consider fog computing?</h2>
<p>As already stated, fog computing has become an essential aspect of IoT, but it&rsquo;s not necessarily a requirement for all enterprises.</p>
<p>Here&rsquo;s a short list of how to determine if you need it for your business.</p>
<h3>If you have:</h3>
<ul>
<li>Data collected at the extreme edge: vehicles, ships, factory floors, roadways, railways, etc.;</li>
<li>Thousands or millions of things across a large geographic area are generating data;</li>
<li>The requirement to analyze and act on this data in less than a second;</li>
</ul>
<p>Then you probably need fog computing.</p>
<h2>The benefits of fog computing</h2>
<p>Extending the cloud closer to the things that generate and act on data benefits the business in the following ways:</p>
<ol>
<li><strong>Greater business agility: </strong>With the right tools, developers can quickly develop fog applications and deploy them where needed. Machine manufacturers can offer Machine-as-a-Service to their customers. Fog applications program the machine to operate in the way each customer needs.</li>
<li><strong>Better security: </strong>Protect your fog nodes using the same policy, controls, and procedures you use in other parts of your IT environment. Use the same physical security and cybersecurity solutions.</li>
<li><strong>Deeper insights, with privacy control: </strong>Analyze sensitive data locally instead of sending it to the cloud for analysis. Your IT team can monitor and control the devices that collect, analyze, and store data.</li>
<li><strong>Lower operating expenses: </strong>Conserve network bandwidth by processing selected data locally instead of sending it to the cloud for analysis.</li>
</ol>
<p>Reference: <a href="https://books.google.com/books?id=U7J2DwAAQBAJ">Advancing</a> <a href="https://books.google.com/books?id=U7J2DwAAQBAJ">Consumer</a><a href="https://books.google.com/books?id=U7J2DwAAQBAJ">-</a><a href="https://books.google.com/books?id=U7J2DwAAQBAJ">Centric</a> <a href="https://books.google.com/books?id=U7J2DwAAQBAJ">Fog</a> <a href="https://books.google.com/books?id=U7J2DwAAQBAJ">Computing</a> <a href="https://books.google.com/books?id=U7J2DwAAQBAJ">Architectures</a></p>
<h2>How does DataStax help?</h2>
<p><a href="https://docs.datastax.com/en/dse/6.7/dse-dev/datastax_enterprise/advReplication/advRepTOC.html">DataStax Enterprise Advanced Replication </a>takes a very straightforward approach to solving these challenges. It allows many edge clusters&mdash;each acting independently and sized, configured, and deployed appropriately for each edge location&mdash;to send data to a central hub cluster.</p>
<p>Data flowing from an edge cluster can be prioritized to ensure the most important data is sent before the less important data. Inconsistent data connections are fully accommodated at the edge with a &ldquo;store and forward&rdquo; approach that will save mutations until connectivity is restored. Any type of workload is supported at both the edge and the hub, allowing for advanced search and analytics use cases at remote and central locations.</p>
<p>With DSE Advanced Replication, clusters at the edge of the enterprise can replicate data to a central hub to enable both regional and global views of enterprise data. Being fully aware of the operational challenges, such as limited or intermittent connectivity, DSE Advanced Replication was designed from the ground up to tolerate real-world failure modes.</p>
<p>Read more about DataStax Advanced Replication <a href="https://docs.datastax.com/en/dse/6.7/dse-admin/datastax_enterprise/advReplication/advRepTOC.html">here</a> and how it provides complete <a href="https://www.datastax.com/why-datastax/data-autonomy">data</a> <a href="https://www.datastax.com/why-datastax/data-autonomy">autonomy</a>.</p>
<h2>The Power of an Active Everywhere Database (White Paper)</h2>
<p><a title="datastax.com" href="https://www.datastax.com/resources/whitepaper/introduction-active-everywhere-database">READ NOW</a></p>

How Fog Computing Powers AI, IoT, and 5G

Madhavan Sridharan

Discover more

Share

More Company

DataStax Astra DB Nabs Three Prestigious 2023 TrustRadius “Best of” Awards, Dominates the Vector Databases Category

DataStax Has Achieved ISO 27001 Certification

Keeping the Momentum Rolling with Google Cloud

My Internship Journey: A Dive into AI

NoSQL and Vector DB
for Generative AI,
Instantly, At Scale

Madhavan Sridharan

Discover more

Share

More Company

DataStax Astra DB Nabs Three Prestigious 2023 TrustRadius “Best of” Awards, Dominates the Vector Databases Category

DataStax Has Achieved ISO 27001 Certification

Keeping the Momentum Rolling with Google Cloud

My Internship Journey: A Dive into AI

NoSQL and Vector DBfor Generative AI,Instantly, At Scale

NoSQL and Vector DB
for Generative AI,
Instantly, At Scale