Skip to content

More modern monitoring: how telemetry and machine learning revolutionize system monitoring

It’s time, take your things and let’s move on to more modern monitoring. Relax, I know how difficult the changes are for you, but if you were able to accept the arrival of DTT and the euro, you sure got this! 

But first let us do a little review:

Traditional system monitoring solutions rely on polling different meters, such as the Simple Network Management Protocol (SNMP), to retrieve data and react to it.

When an issue requiring attention is detected, an event is triggered, which can be notified through email to the administrator or by launching an alert.

Consequently, the administrator responds according to the nature of the problem.

However, this centralized approach to monitoring requires a considerable amount of resources.

You knew it?

Due to the “pull” nature of the requests, gaps are generated in the data and these could lack sufficient granularity.

In response to this limitation, the adoption of a telemetry-based monitoring solution has emerged as a promising alternative.

The day has come: discover more modern monitoring

By making the switch to a modern approach to monitoring, you gain access to smarter and richer solutions in terms of anomaly detection.

This transition represents a great advantage in the field of system monitoring.

In addition, another compelling reason to implement modern monitoring is the growing number of systems that rely on accurate monitoring to enable automated infrastructure operations, such as scaling nodes up or down.

If monitoring fails or is not accurate enough, disruptions can arise in the expected scalability of an application.

Therefore, reliable and accurate monitoring is essential to ensure the proper functioning of the systems.

To improve the efficiency and accuracy of surveillance systems, organizations are exploring smarter, more advanced solutions.

Telemetry vs. Poll: Differences and benefits in modern system monitoring

When it comes to implementing telemetry in surveillance systems, it is important to understand the differences between the streaming and polling approaches.

While streaming telemetry can be more complex, its design offers greater scalability, evidenced by public cloud providers such as Amazon, Microsoft, and Google.

These tech giants manage millions of hosts and endpoints that require constant monitoring.

As a result, they have developed telemetry and monitoring channels with no single points of failure, enabling them to gain the level of intelligence and automation needed to operate at a great scale in their data centers.

Learning from these experiences can be invaluable when building your own monitoring solutions.

In contrast, survey-based monitoring solutions may face scalability challenges.

Increasing the polling interval for a specific performance counter increases the load on the system being monitored.

Some meters are lightweight and can be probed frequently, but other heavier meters generate significant overhead.

Consistent data transmission may appear, at first glance, to involve greater overhead compared to a polling solution.

However, thanks to technological advances, lightweight solutions have been developed.

In many cases, data flows through a flow query engine that enables outlier detection while storing all data to support trend analysis and machine learning.

This architecture is known as lambda architecture and is widely used in applications that go beyond monitoring, such as in the Internet of Things (IoT) devices and sensors.

It provides real-time alerts for values outside normal limits, while enabling cost-effective storage of recorded data, providing deeper analysis in a low-cost data warehouse.

The ability to have a large amount of recorded data allows for comprehensive analyses of transmitted values.

System monitoring: Smart approaches and machine learning for accurate alerts

In the system monitoring area, it is crucial to ensure data quality to obtain accurate and relevant alerts.

Most monitoring tools offer the ability to customize alert ranges.

*For example, you may want to receive an alert when CPU usage exceeds 80% on certain systems, while on other systems a high level of CPU usage may be part of its normal operation.

However, finding the right balance can be tricky:

  • On the one hand, you don’t want alerts to overwhelm administrators with irrelevant information.
  • On the other hand, you also don’t want to set too lax thresholds that hide critical issues in your data center.

To address this dichotomy, it is advisable to use intelligent or dynamic monitoring approaches.

These approaches capture a baseline for each system and only trigger alerts when values are outside normal limits for both the specific server and the corresponding time frame.

As more data is collected, many monitoring tools are deploying machine learning systems to perform deeper analysis of the data.

This advanced processing makes it possible to generate smarter alerts based on the specific workload of each system.

Machine learning is used to detect subtle patterns and anomalies that might go unnoticed by traditional alert rules.

However, it is important to note that it is essential to verify that these smart alerts work correctly and provide the expected alerts.

Extensive testing and result validation is necessary to ensure that alerts are generated accurately and in a timely manner.

*That way, a more efficient and reliable surveillance system will be achieved.

Monitoring continuity: Key strategies and approaches for detecting problems in systems

As your organization seeks to implement smarter monitoring, the crucial question arises:

How do we detect problems or outages in our monitoring systems?

As automation connected to these systems becomes increasingly reliant, monitoring becomes an even greater challenge.

There are several measures that can be taken to ensure monitoring continuity:

  • First, it is critical to create redundancy in the infrastructure, either by deploying virtual machines or leveraging platform-as-a-service (PaaS) services across different data centers or cloud regions. This ensures that, in the event of failures at a point, alternative systems are in place to support monitoring.
  • Another option is to establish a custom or secondary alert mechanism that verifies the status of the primary monitoring system and acts as an additional security layer.
  • It is also possible to implement an alert process, which generates alerts at regular intervals, and have a scaled mechanism that issues an additional alert if the process is not activated as expected.

In addition to these approaches, it is important to ensure that the alert mechanism covers all application layers and it is not limited to just one.

*For example, it is necessary to perform tests and monitoring in the web layer, the cache storage layer and the database, to detect any failure or anomaly in any of them and receive relevant alerts.

Keeping online supervision requires a proactive and solid approach in terms of architecture and strategy.

By implementing these security and verification measures, it is ensured that any problems or interruptions in monitoring systems are quickly detected and addressed, allowing a timely response to maintain the proper functioning of critical systems.

Conclusions

Taking the leap to more modern monitoring is a smart and necessary decision to ensure proper system functioning.

Although the changes may seem intimidating, remember that you survived the Ibook and egg-free mayonnaise, so this should be a piece of cake!

Telemetry is presented as a promising alternative, offering smarter solutions and more accurate anomaly detection.

In addition, the implementation of redundancy measures, custom alert mechanisms and extensive testing at all layers of the application will ensure reliable and timely monitoring.

So get ready to embrace modern monitoring and leave outdated methods behind!

Remember, in the world of monitoring, to be modern is to be more modern than the average human.

And you’re ready to be the “cool kid” of monitoring!

About Version 2 Digital

Version 2 Digital is one of the most dynamic IT companies in Asia. The company distributes a wide range of IT products across various areas including cyber security, cloud, data protection, end points, infrastructures, system monitoring, storage, networking, business productivity and communication products.

Through an extensive network of channels, point of sales, resellers, and partnership companies, Version 2 offers quality products and services which are highly acclaimed in the market. Its customers cover a wide spectrum which include Global 1000 enterprises, regional listed companies, different vertical industries, public utilities, Government, a vast number of successful SMEs, and consumers in various Asian cities.

About PandoraFMS
Pandora FMS is a flexible monitoring system, capable of monitoring devices, infrastructures, applications, services and business processes.
Of course, one of the things that Pandora FMS can control is the hard disks of your computers.

Install Pandora FMS with our online installation tool

Hello again, Pandoraphiles! Today on our beloved blog we want to introduce you to a video. You know that from time to time we do just that, don’t you? Bringing back some video from our channel, the nicest and most relevant one, no question, and break it down a little bit in writing. 

All of that so that you may have the book and the audiobook, so to speak.

Well, today we are going with… drum roll:

In this article, as in the video, we will guide you through the installation process of Pandora FMS environment, using the handy online installation script.

With this tool, you can quickly set up your system and start taking advantage of all the monitoring and management possibilities offered by Pandora FMS.

Before we begin, make sure you meet the following requirements to ensure a successful installation:

  1. First of all, your machine must have access to the internet, since the installation script requires access to multiple URLs and official repositories of the distribution you are using.
  2. Likewise, check if you have the “curl” command installed, which usually comes by default in most distributions.
  3. It is important to have the recommended minimum hardware requirements, for optimal system performance.
  4. When you are ready to start the installation, make sure to run the commands as root user.
  5. Finally, make sure you have a compatible OS. In this case, the installation can be done on CentOS 7, Red Hat Enterprise Linux 8, or Rocky Linux 8. If you’re using a Red Hat distribution, make sure it’s activated with a license and subscribed to standard repositories.

In the specific case of this video/article, we created a machine with Rocky Linux 8.

If you already have all the other requirements, just check that you are actually running the commands as root user, and proceed with the execution of the online installation tool. This process will install the latest available version of Pandora FMS.

Installation

Now wait for the installation process to finish.

Once the installation process is completed, you will be able to access Pandora FMS console through your browser.

In the video, in addition, we present you with a valuable addition:

We will check out the environment variables that you may modify prior to installing Pandora FMS.

Among the variables that you may adjust there is:

  • The time zone, through the TZ variable.
  • The database host, as well as the database name, username, and password.
  • You may also specify the database port and password of the root user, which is “pandora” by default.

In addition, you are given the option to skip checking for a previous Pandora FMS installation, skip the installation of a new database, or the recommended kernel optimization.

These options allow you to adapt the installation to your specific needs.

Likewise, there are variables such as MYVER or PHPVER that allow you to define which version of MySQL and PHP you want to install.

With MySQL, you may specify “80” for MySQL 8 or “57” as the default option for MySQL 5.7. In the case of PHP, you may specify “8” for PHP8 or “7” by default for PHP7.

Continuing with the customization of Pandora FMS environment, you will also have the option to define the URLs of the RPM packages of Pandora FMS server, console and agent.

By default, these URLs point to the latest available version, ensuring that you are always using the latest improvements and bug fixes.

It is important to note that there is also the possibility to indicate whether you want to install the packages of the latest beta version available.

However, it is recommended to use this option only in test environments, as beta versions may contain experimental features and may not be as stable as stable versions.

If you want to install specific packages, this option will be automatically ignored.

 

About Version 2 Digital

Version 2 Digital is one of the most dynamic IT companies in Asia. The company distributes a wide range of IT products across various areas including cyber security, cloud, data protection, end points, infrastructures, system monitoring, storage, networking, business productivity and communication products.

Through an extensive network of channels, point of sales, resellers, and partnership companies, Version 2 offers quality products and services which are highly acclaimed in the market. Its customers cover a wide spectrum which include Global 1000 enterprises, regional listed companies, different vertical industries, public utilities, Government, a vast number of successful SMEs, and consumers in various Asian cities.

About PandoraFMS
Pandora FMS is a flexible monitoring system, capable of monitoring devices, infrastructures, applications, services and business processes.
Of course, one of the things that Pandora FMS can control is the hard disks of your computers.

A glimpse into the day-to-day life of a software monitoring expert

Working in the field of software monitoring may seem boring or too technical, but let me tell you that there is more fun and excitement than one might imagine at first.

Not that we’re all day doing barbecues and celebrating, but once we almost did our very own Olympics in the office! Kind of like The Office, you know.

*Long live Michael Scott.

Anyway, join me on this journey for a day in the life of a software monitoring expert, where code lines mingle with laughter and soluble coffee.

Our protagonist, whom we will affectionately call “Captain Monitor”, will face in this pseudo-documentary of flora and fauna, a day full of technical challenges and unexpected surprises.

From the moment he opens one of his lazy, rheum-covered eyes to the moment he closes his latest generation laptop, his life is a roller coaster ride of hilarious emotions and situations.

Early morning

Let’s start with the morning rush hour, exactly when Captain Monitor faces the dreaded flood of alerts in his inbox.

While trying to classify and prioritize alerts, he comes across one that says:

“The main server has become an orchestra of mariachis who just got completely wasted, from the Tenampa Hall to Plaza Garibaldi!”

Yes, you read that right:

It turns out that a “fellow” prankster decided to play a little joke on him and change the alert tones to Lucha Reyes rancheras.

But the surprises don’t end there!

Late morning

During a team meeting, Captain Monitor discovers that his charming cubicle companion has turned his desk into a jungle of cables, pins, modems and other electronic devices…

Between the giant monitor and the stacks of hard drives, the Captain seems to be lost in a kind of modern version of Alan Parrish’s Jumanji.

No matter how much he insists that monitoring modern software doesn’t actually require a work environment of such high technological sophistication, his partner continues and continues to pull plugged-in tinkerers to mock up his particular digital fantasy world.

Early afternoon

In the midst of testing and system tweaks, Captain Monitor also faces the challenges of dealing with “forgetful users.”

Yes, that user who calls all the time with problems that could be solved with a simple reboot.

But our hero doesn’t give up easily and becomes the master of basic reset instructions.

Sometimes he even dreams, as he sleeps in the toilet at nap time, of a life where he doesn’t have to say:

“Have you tried to reboot your device yet?”

Deep Afternoon

But it’s not all chaos and micro-ulcers in the world of software monitoring. Captain Monitor, who as you guessed works in the Support Department, also has his moment of glory when he manages to detect and solve a critical problem of global scale before it causes a collapse in the system of the floral commissioning company he monitors.

In that moment of triumph he feels like he’s on the main stage of a rock concert, with the crowd cheering and the fireworks bursting on top.

“Yes, this is the life I have chosen and I like it!,” exclaims to himself.

Just before the end of the day

At the end of the day, when not all danger is over, but he starts just ignoring it anyway out of pure exhaustion, Captain Monitor relaxes and shares some funny anecdotes with his colleagues in the break room.

They all laugh their asses off and share similar stories of technical madness and tense situations with customers.

It is, more than ever, in those shared moments when Captain Monitor realizes that, despite the challenges and the three thousand crises he suffers daily, there is a special camaraderie among the experts in software monitoring.

They are a close-knit, adventurous, cool community!

Here we go again

And so, the next morning, we are confident that Captain Monitor will rise and shine with renewed energy, ready once again to face another challenging day in the exciting world of software monitoring.

Because while there may be times of frustration and stress… There is nothing quite like the satisfaction of discovering and solving problems to look good with the boss!

Dimas P.L., de la lejana y exótica Vega Baja, CasiMurcia, periodista, redactor, taumaturgo del contenido y campeón de espantar palomas en los parques. Actualmente resido en Madrid donde trabajo como paladín de la comunicación en Pandora FMS y periodista freelance cultural en cualquier medio que se ofrezca. También me vuelvo loco escribiendo y recitando por los círculos poéticos más profundos y oscuros de la ciudad.

Dimas P.L., from the distant and exotic Vega Baja, CasiMurcia, journalist, editor, thaumaturgist of content and champion of scaring pigeons in parks. I currently live in Madrid where I work as a communication champion in Pandora FMS and as a freelance cultural journalist in any media offered. I also go crazy writing and reciting in the deepest and darkest poetic circles of the city.

About Version 2 Digital

Version 2 Digital is one of the most dynamic IT companies in Asia. The company distributes a wide range of IT products across various areas including cyber security, cloud, data protection, end points, infrastructures, system monitoring, storage, networking, business productivity and communication products.

Through an extensive network of channels, point of sales, resellers, and partnership companies, Version 2 offers quality products and services which are highly acclaimed in the market. Its customers cover a wide spectrum which include Global 1000 enterprises, regional listed companies, different vertical industries, public utilities, Government, a vast number of successful SMEs, and consumers in various Asian cities.

About PandoraFMS
Pandora FMS is a flexible monitoring system, capable of monitoring devices, infrastructures, applications, services and business processes.
Of course, one of the things that Pandora FMS can control is the hard disks of your computers.

Introduction to Docker: Revolutionary technology for intrepid developers

Put on your seatbelts, intrepid developers! In this era of technology trends and digital-first strategies, organizations are jumping on board the microservices train with Docker containers.

What is Docker? 

Well, it’s like a magic box that wraps your app with everything it needs to actually work, like a file system, tools, and even a roadmap to reach multiple platforms.

It’s like your software has its own travel-ready backpack!

Microservices: the new superhero team of programming

Today, developers are using Docker to build microservices, which are like the Avengers of the software world.

These microservices are small pieces of code that work together to perform specific tasks. For example, imagine a pizza chain that uses microservices to take orders, process payments, and coordinate deliveries across the country. It’s like having a league of pizza-efficient superheroes working together!

The star role of docker engine and his gang

When we talk about Docker, we can’t help but mention Docker Engine, the leader of this container gang.

Docker Engine is responsible for building and running the containers. But before you can do that, you need a Docker file.

Think of it as the script of a movie that defines everything necessary for the image of the container to come to life. Once you have the Docker File, you may build the container image, which is like the main actor running in the Docker engine.

Docker Compose and Docker Swarm: The adventure companions of Docker

The fun doesn’t end there!

Docker offers more adventure companions, such as Docker Compose and Docker Swarm. Docker Compose allows you to define and run applications in containers, like the movie director who coordinates all the scenes.

And then there is Docker Swarm, which converts a group of Docker servers into one, as if merging the Power Rangers to form a megazord. It’s every director’s dream to have a united team ready for action!

Docker Hub feast and Open Container Initiative (OCI) party

But wait, we’re not going to stop our analogies, there’s even more! Docker Hub is like a developer food buffet, filled with containerized microservices ready to be devoured.

Do you need a web server? A database? You’ll find a bit of everything here!

It’s like a party where all the main services are invited. In addition, Docker has created the Open Container Initiative to ensure that the packaging format is universal and open. It’s like ensuring that all guests follow the rules of etiquette.

AWS ECS: Amazon’s Container Management Service to the rescue!

If you are playing in the world of Amazon Web Services, you have at your disposal Amazon EC2 Container Service (ECS), which is a highly scalable and safe container management service.

With ECS, you can easily deploy and manage your microservices in Docker containers in the Amazon cloud. Imagine having a team of assistants take care of all the infrastructure and logistics, while you focus on developing and deploying your containerized applications.

Dare to build your own microservices architecture with Docker!

Now that you know the basics of Docker, microservices, and associated tools, it’s time to venture out and build your own microservices architecture with Docker.

Remember that microservices allow you to split your application into separate components, making it easy to scale and maintain.

With Docker, you can package and deploy each microservice in a container, taking full advantage of the flexibility and portability this technology offers.

Get ready for a new way to develop apps!

Docker and microservices are revolutionizing the way we develop and deploy applications.

With their modular approach, scalability, and portability, this combination has become a popular choice for many organizations.

Whether you’re building a complex enterprise application or a simple web application, consider adopting a microservices architecture with Docker to take advantage of the benefits it offers.

It’s time to take the leap and discover the exciting world of containerized applications!

Once you have built your microservices architecture with Docker, new possibilities will open up for your application development.

Here are some additional ideas for you to consider:

  • Container orchestration: In addition to Docker, there are tools like Kubernetes and Docker Swarm that allow you to efficiently orchestrate and manage your containers in production.
    These tools will help you scale your services, distribute the workload, and make sure your apps are always available.
  • Continuous Implementation (CI) and Continuous Delivery (CD): With Docker, you can easily integrate your microservices into a CI/CD workflow.
    This means you can automate the process of building, testing, and deploying your containers, streamlining the development lifecycle and allowing you to launch new features faster.
  • Monitoring and logging: As your applications grow in complexity and scale, it’s critical to have monitoring and logging tools in place to maintain good performance and troubleshoot issues.
    Tools like Prometheus, Grafana, and ELK Stack are very popular in the Docker ecosystem and will help you monitor and analyze the performance of your containers and microservices.
  • Security: When using Docker containers, it is important to keep security best practices in mind.
    Make sure to apply patches and updates regularly, use reliable and secure images, and consider using vulnerability scanning tools to identify potential issues in your container images.

Conclusions

Docker and microservices are ever-evolving technologies, and there’s always more to discover. Keep learning about new tools and approaches, participate in communities and conferences, and stay on top of the latest trends. The world of containers and microservices is full of exciting and challenging opportunities!

About Version 2 Digital

Version 2 Digital is one of the most dynamic IT companies in Asia. The company distributes a wide range of IT products across various areas including cyber security, cloud, data protection, end points, infrastructures, system monitoring, storage, networking, business productivity and communication products.

Through an extensive network of channels, point of sales, resellers, and partnership companies, Version 2 offers quality products and services which are highly acclaimed in the market. Its customers cover a wide spectrum which include Global 1000 enterprises, regional listed companies, different vertical industries, public utilities, Government, a vast number of successful SMEs, and consumers in various Asian cities.

About PandoraFMS
Pandora FMS is a flexible monitoring system, capable of monitoring devices, infrastructures, applications, services and business processes.
Of course, one of the things that Pandora FMS can control is the hard disks of your computers.

Learn how to monitor Linux computers with Pandora FMS: Full guide

Today, in those much needed training videos, we will delve into the exciting and mysterious universe of basic monitoring of computers with Linux operating systems. Ready to unlock the hidden secrets of your devices? Well, let’s go!

Before you dive into this adventure, make sure you have Pandora FMS environment installed and running.

Done?

Well, now we will focus on how to monitor those Linux computers that allow you to install the software agent devoted to this operating system.

The first point is to install the software agent on the Linux computer you want to monitor.

For that purpose, follow a series of magic commands that will install the necessary dependencies.

Who said monitoring didn’t have its own spells?

Once dependency installation is finished, go into software agent installation.

That’s when true magic begins.

Pay attention!

Configure the agent to point to your Pandora FMS server through the “server_ip” parameter.

In addition, activate remote configuration by changing the value of the “rimout_config” parameter to 1.

If you want to give it a personal touch, you may also assign it a specific group using the “group” parameter, which is “Servers” by default.

Take advantage, here you can be the director and assign roles to your agents!

Once you’re done with all these configurations, save the changes and launch the Software Agent with the command “/etc/init.d/pandora_eiyent_deimon start”.

Can you see Linux computer monitoring coming to life?

Now you can see how your agent appears in the console of your Pandora FMS server, in section “Resources, Manage Agents“.

If you go into the main view or the module view, take a look at the information that the software agent obtains by default from Linux systems.

CPU, RAM and disk space? You won’t miss a byte!

But wait, there’s more!

You may also enable the inventory plugin for detailed information.

Just go to the agent plugins view and turn on the inventory light bulb.

Afterwards, you’ll just have to wait for the next agent interval, or if you can’t resist it, manually restart it to receive the inventory data.

The information will be within reach!

But that’s not all.

Let’s add a touch of excitement to this story!

Imagine that you receive a critical alert from your agent and need to act immediately. Don’t worry, Pandora FMS has the perfect solution!

Just go to the “Alerts, Alert List” section and click “Create”, you may create a custom alert.

Choose the agent you want to monitor, select the appropriate module (you may choose intriguing names like “Host Alive”!), and set an action to notify you by mail when the module is in “Critical” status.

Isn’t it great?

Now you can solve the most high-priority cases in the blink of an eye!

But wait, you want more secrets unraveled?

Then here is another tip for you.

Discover predefined local components and learn how to create modules from them.

Go to “Settings, Templates, Local Components” and dive into a world full of possibilities.

If you’re a Linux lover, you may filter and explore local components specific to this operating system.

Now select a local component and create a new “data server module” module. Add the local Linux component you like the most and bring your new module to life. You’ll just have to wait for the next agent interval or, if you’re impatient, manually restart it to see the results.

Conclusions

Basic Linux monitoring with Pandora FMS is not only effective, but also exciting and fun.

So don’t wait any longer, sharpen your monitoring skills and let the action begin in the world of Pandora FMS!

Remember, in the video description you will find useful links that will guide you through each step.

Don’t miss it, as you don’t miss any videos from your channel, and start your journey towards basic Linux monitoring with Pandora FMS!

About Version 2 Digital

Version 2 Digital is one of the most dynamic IT companies in Asia. The company distributes a wide range of IT products across various areas including cyber security, cloud, data protection, end points, infrastructures, system monitoring, storage, networking, business productivity and communication products.

Through an extensive network of channels, point of sales, resellers, and partnership companies, Version 2 offers quality products and services which are highly acclaimed in the market. Its customers cover a wide spectrum which include Global 1000 enterprises, regional listed companies, different vertical industries, public utilities, Government, a vast number of successful SMEs, and consumers in various Asian cities.

About PandoraFMS
Pandora FMS is a flexible monitoring system, capable of monitoring devices, infrastructures, applications, services and business processes.
Of course, one of the things that Pandora FMS can control is the hard disks of your computers.