Blog

How Kafka ensures scalability of IoT applications

Since the IoT buzzword was coined, it has gone beyond turning on lights and TVs from a remote location. IoT applications have expanded beyond consumer applications, and it’s being applied in retail, manufacturing, energy, and other industries. An IoT network is no longer confined to a handful of devices. Instead, the IoT infrastructure has to…

No bottlenecks by scaling your development teams

No bottlenecks by scaling your development teams Today’s development teams are associated with terms like ‘agile’ and ‘sprint’. The demand for shorter time-to-market and feature-rich apps delivers enormous pressure to development teams. If you’re a team leader, you’ll be familiar with coordinating the tasks between members and staying on schedule. However, Murphy’s Law often strikes…

Axual Release Update 2020.3

We've entered the third quarter of the year and we are excited to announce Axual third update of the year, Release 2020.3. And in the following video Joris Meijer will explain all the details: What does it include? Deploying Axual on kubernetes As of 2020.3, we support the package manager named helm, which helps…

Technology trends for future: Real-Time Data Streaming is the way to go

2020 was the year of reshaping the way we think about big data, as we experienced how important it is to combine Artificial Intelligence (AI) in analyzing massive amounts of data to make decisions. Real-time data streaming is the way to go forward. While software developers are excited about new technologies to deliver information, real-time…

Challenges in building a data exchange infrastructure

With Axual you can have a nervous system for data exchange

Data exchange is part of a business like the nervous system inside our organism. Like the nervous system, a data exchange system acts as the control center which determines and monitors all actions and inputs as well as providing the processing and memory functions. An example of a real-time da exchange system in the real…

Everything you need to know about data lineage

On the blog, we’ve talked about the multiple ways in which Big Data and Business Intelligence are reshaping the business world right now, particularly in how they help business owners make better decisions. As industries are increasingly reliant on data, you’ll need to start questioning where the data comes from and how it changes…

How do you and your team act faster and better on changing circumstances?

In a matter of months, DevOps teams have been faced by a new reality. The Covid-19 pandemic has plunged the world into turmoil, but the demand for software development is on an uphill trend. While the latter is good news for the DevOps team, the expectations are high. Software needs to be delivered in a…

5 Ways to Digitally Transform Your Small Business

5 ways to digitally transform your small business Digital transformation is no longer limited to giants like Amazon. The changing consumer behaviours and increasingly competitive market have forced small businesses to transform digitally or drop into the abyss of obsolescence. According to Forbes, 70% of businesses already have a digital strategy or working on one.…

Real World Examples of Business Intelligence in Action

Real-World Examples of Business Intelligence in Action Raw data are hardly meaningful until they are processed, analyzed, and leveraged to fuel your business’s growth. In recent years, Business Intelligence (BI) has been driving the economic growth of companies of all sizes by turning big data into useful analytics. By turning to Business Intelligence, companies are…

Examples of Big Data Applications in the Real World

In 2019, companies worldwide had invested a whopping $180 billion in Big Data analytics and there’s no sign of stopping. Big data, which is a large amount of structured and unstructured data beyond the processing capability of conventional methods, continues to fuel the growth of leading companies. Here are 5 examples of how big…

Self Service Tutorial – How to Create a Group on the Axual Platform

How to Create a Group on the Axual Platform On the Axual platform, groups are important because they are the basic unit of ownership. Every other object, such as a stream, application, or environment, is owned by a group. Looking at how vital groups are, you need to know how to create one and add…

Be Ahead in Business: Respond Faster to Changing Internal and External Circumstances

Be Ahead in Business: Respond Faster to Changing Internal and External Circumstances Businesses operate in a highly dynamic and competitive environment that has a significant influence on whether they achieve their objectives or not. This dynamic environment consists of external and internal forces. The external forces may be economic, demographic, social, technological, political, legal, etc.…

Why Big Data is Interesting for Small Businesses

Why Big Data is Interesting for Small Businesses If you think big data is only for big companies, like Amazon or Facebook, you are missing out. In fact, small businesses can leverage their size and agility to make data-driven decisions much more efficiently while capturing the power of big data. How? Thanks to software solutions…

Expresso – How can you produce and consume data from your data streaming application?

In the third episode of Axual Expresso, a series of short videos where we learn more about streaming and the Axual Platform, Elise learns how you can produce and consume data from your data streaming application and how easy it is to create a Data Streaming Application on the Axual Platform with a quick demo…

Expresso – Producers & Consumers

In the second episode of Axual Expresso, a series of short videos where we learn more about streaming and the Axual Platform, Elise learns what consumers and producers are and how you can create an application easily on the Axual Platform with a short demo by Abhinav Sonkar. More to come If you missed the…

Case study Eneco

Apache Kafka Use Cases in Real Life

Digital Transformation The vast development of the digital world, particularly in the 21st century, has led to the generation of a massive volume of data. Therefore, any company that wants to remain relevant today and the near future must learn how to handle a huge amount of data through a flexible, robust, and scalable platform.…

Leveraging Data Analytics for Decision Making

Download our whitepaper Want to know how we have to build a platform based on Apache Kafka, including the learnings? Fill in the form below and we send you our whitepaper. [activecampaign form=107] Gut feelings will only drive your business to a certain extent before you’re faced with challenges that demand reasoned and data-driven…

Important Kafka Performance Metrics to Monitor

Important Kafka Performance Metrics To Monitor Apache Kafka has become the preferred infrastructure in managing the increasing volume of data flow and processing needed by modern businesses. Kafka’s reliability, speed, and scalability resulted in early adopters like Netflix while capturing the attention of small to medium firms. Kafka is an asynchronous messaging infrastructure made up…

Release Update 2020.2

As promised, here is the second scheduled release update from Axual, the 2020.2, and it is an exciting one! We’re open-sourcing! We are excited to announce that we will start open-sourcing more components of our platform, making them publicly available. We have been relying on the help of a great community for a number of…

Real-time Business Intelligence: Meaning and Importance

Real-time Business Intelligence: Meaning and Importance 1.0 Introduction The business world is increasingly more competitive, and especially today more than ever before. Only companies with the best business intelligence techniques stand a chance to succeed. Whether yours is a start-up or an established firm, you need to adopt real-time business intelligence to make crucial decisions…

Axual & Conclusion join forces

Axual & Conclusion join forces Axual and Conclusion are pleased to announce their business partnership. Combining Axual’s real-time streaming software with Conclusion’s expertise on mission-critical platforms, we will collaborate together to deliver excellent service to our mutual clients. The partnership between Axual and Conclusion is already on a successful path as both companies work together…

How Kafka Adds Value in Big Data Ecosystems

How Kafka Adds Value in Big Data Ecosystems In the past few years, there’s been increasing growth in the use of big data tools to serve a variety of business issues and solutions. The realm of big data is getting popular by the day, and so is the demand for technologies linked to this massive…

Expresso – What is a stream?

In today’s first episode of Axual Expresso, a series of short videos where we learn more about streaming and the Axual Platform, Elise learns about the definition of a stream and in what scenarios and why a stream is useful to process data in real-time. Also, Abhinav shows how easy it is to create a…

Data Architecture Management Explained

New technologies and innovative ideas are shaping the 21st-century business world. In this developmental journey, data is king and it's playing a critical role. One of the concepts at the basis of big data application in successful businesses is data architecture management. In this article, you will get acquainted with the definition of data architecture…

Why Data Analytics are Important for Businesses?

As a company, you want to know how to stay competitive in the future. You want to understand how much loyalty you have got in your market and know who is buying your product at a particular time. Also, you want to figure out why and when you lose or gain customers. The best way…

Should You Outsource Or Insource Data Analytics?

As you have more and more data piled up for you, the analysis and management of such data in the most optimal way become a major concern. This is because only the optimal use of the data can guarantee a competitive advantage for your business. So this is the exact reason why data analytics is…

What are the Benefits of Real-Time Data Warehousing?

In traditional data warehouses, you can’t find the most current data. Instead, data is uploaded into the warehouse based on time intervals like weekly, monthly, or daily. However, this is no longer an efficient way to store data looking at the realities of the current digital age. With artificial intelligence and machine learning, companies are…

What are Kafka Streams?

Kafka is no longer a new thing especially to people who may have worked on huge amounts of data before. It is a distributed, fault-tolerant system designed for fast processing of huge volumes of data. Meanwhile, stream processing is the real-time processing of data concurrently, in a continuous and record-by-record way. Now, what are Kafka…

How to do Event Sourcing with Kafka

Event sourcing is the process of ensuring that all changes to application state are stored as a sequence of events. But how do you manage this in Kafka? Let’s find out in this article to get you started with the concept of real-time data streaming, something our team over at Axual is an expert in…

Lambda Architecture

In recent times, there has been a surge in the usage of lambda architecture. Mostly, it’s seen beside real-time analytics and big data. So you might have the question, what exactly is a lambda architecture? Don’t worry! In today’s article, we’re going to discuss what lambda architecture is. We’re also going to discuss its various…

Best Practices In Data Analytics

Businesses are increasingly reliant on data analytics to track progress, build strategies, improve strategic decision making, and really you could apply and benefit from data analytics on any aspect of your organization. However, the success in applying data analytics depends on the ability of data analysts to transform raw data into valuable insights. Here are…

What is Real-time Reporting?

As the name implies, real-time reporting is the process of reporting an event at the moment it happens. Gone are the days when companies could only gather their data during monthly or quarterly intervals. The narrative has changed with real-time reporting; businesses and organisations can now access and view their data instantly without any delay…

What is Data Streaming?

What is data streaming? Simply put, data streaming is the process of transmitting, processing, and ingesting data continuously rather than in batches. This is the present and future way to handle data especially for organisations that want to analyse data and get results in real-time. As the stream passes, you analyse continuously and get results…

Difference Between Producing and Consuming Applications

What is de difference between producing and consuming applications? People often wonder about these differences. First, looking at the two terms, a producer makes what the consumer takes in. It is as simple as that. Now, let's get into technical details regarding Kafka consumer and Kafka producer. A Kafka producer is a program that produces…

Data Analytics vs. Business Analytics

Data Analytics vs. Business Analytics Data has transformed the world and is powering decision-making in industries. From higher institutions to tech firms, government agencies to non-profits, data has helped organisations to boost sales, launch new products and services, expand operations, and increase efficiency. This is the simple reason why organisations have embraced both data analytics…

Release update 2020.1

Here it is, the latest version of Axual, the 2020.1 release. The new version introduces new features that allow you to speed up development, do testing and incident resolution with “Stream Browse & Search”, hook up external systems to Axual REST proxy and maintain schemas for your streams using Schema Upload. Also, we have now adopted…

What are Kafka Tools?

A lot of businesses are adopting Apache Kafka as they are aware of the great benefits it brings to the business. In this post, we will go one step ahead, explaining what Kafka tools are. For first-time readers, Kafka is a publish-subscribe messaging system that enables users to send messages between applications, processes, and servers.…

How do you manage Kafka?

Kafka is the game-changer for data-driven organizations. The data streaming platform has surged in popularity due to its speed, scalability, and fault-tolerance. However, it’s a mistake to assume that the clusters of brokers will not be plagued by problems when it’s deployed. Why You Need To Manage Kafka When Is Up And Running In an…

What Are Real-Time Data Services?

At the highest level, the winner of a sprint is often decided by mere milliseconds. In today’s business environment, the slight difference in the availability of data can give you an edge over others.. Real-time data services are increasingly important to ensure a business stays competitive amidst the influx of information. Real-Time Data Services Explained …

Kafka Monitoring: Using Metrics to monitor your Empire

By Jimmy Kusters Kafka Monitoring: Using Metrics to monitor your Empire What Kafka is has been further detailed in previous articles, but suffice to say that Apache Kafka is a “fault-tolerant event streaming platform”. It aims at reliability, scalability and high throughput, which performs well while being able to handle outages to a certain…

Top Things to Know About Real-Time Data Processing

Top things to know about real-time data processing Today, the most important asset of a business is data. To keep pace with modern technology, a business needs to keep up to date with data in real-time. Any business can use the updated data to collect information and sell their products if and only if, their…

Examples of Kafka architecture solutions

Examples of Kafka architecture solutions The term ‘big data’ is no longer a buzzword, but a common reality of processing massive streams of data in modern businesses. Traditional approaches to making sense of immense data-driven events are no longer efficient, which lead to the birth of Apache Kafka in 2010. What Is Kafka The Apache…

Why should you Deploy Kafka Clusters on Kubernetes?

Why should you Deploy Kafka Clusters on Kubernetes Apache Kafka is a popular open-source tool for message streaming. It can be used to store and process huge amounts of data and can allow applications to utilise streams of data in real-time. Kafka is typically used together with Apache Zookeeper to create scalable and fault-tolerant clusters…

What Is Apache Software?

Kafka Software Spark, Hadoop, Python, Tensorflow – an increasing number of software, frameworks, and platforms are emerging to help businesses get control over their huge volumes of data, and this can be overwhelming. Kafka software rises, amid the others, as a specifically designed software for speedy, real-time data processing making AI and Big Data possible. …

What Is Data Governance And Why Does It Matter?

What Is Data Governance And Why Does It Matter? If there's something in business that you really want to do is being fast at processing data/orders. But sometimes this should not be the priority, because being fast is not necessarily a synonym of efficiency." Or something different but still more specific. In terms of SEO…

What are Data Governance Tools?

Data Governance Tools In any business-grade Kafka deployment and configuration, you must develop a solid governance framework to guarantee the security of private and confidential data as well as who is dealing with data and what types of operations are carried out on that data. Furthermore, governance framework determines who can access what kind of…

What is Apache Kafka?

What is Apache Kafka? Thousands of businesses are built on Kafka, and for good reasons. Kafka is a scalable, community distributed event streaming platform and publish-subscribe messaging system. Kafka is used to develop distributed applications and facilitate web-scale internet businesses like Twitter, LinkedIn etc. Being scalable, it is not only used by Internet unicorns, but…

Real-time Financial Alerts at Rabobank with Apache Kafka’s Streams API

Real-time Financial Alerts at Rabobank with Apache Kafka’s Streams API This article, written bij Axual founder Jeroen van Disseldorp, discusses the use of Apache Kafka’s Streams API for sending out alerts to customers of Rabobank. Rabobank is based in the Netherlands with over 900 locations worldwide, 48,000 employees, and €681B in assets. It is a bank by…