You have interesting data: radar data, security logs, Iot data, pictures, and you wonder how to best combine archiving and indexing capabilities. To perform efficient queries and benefit from optimal (near) real-time performance, you need to select the right (indexed) database. In contrast; to archive lots of data for months Read more…
Dealing With Python Apps The punch story with python is an old one. We implemented an elasticsearch aggregator tool in the Brad release (now deprecated), we also leveraged the elasticsearch curator application that we provide as a deployable administrative service in the Craig release. More importantly, we decided to fully Read more…
Craig Release Latest News This 2019 summer was quite active, and I am happy to share lots of interesting news regarding the current and future punch releases. Before We Start Maybe you are not familiar yet with the punch. Here is a quick recap. The punch is a ready-to-go-production data Read more…
Big Data Paris 2019 Workshop Tuesday 12th of March, 14H00 Machine Learning for Critical Systems Damien Fontanes, Dimitri Tombroff Abstract In real-life critical systems and applications, accessing the data to test, tune and run artificial intelligence algorithms involved several under-estimated problems. The first challenge is mainly to provide consistent tools Read more…
The Craig punchplatform version 5.1.2 is released. This post gives an overview of the new features. New Features The Craig punchplatform 5.1.2 has a number of important new features. First off, it leverages many important component updates: Elastic 6.5.4 stack Kibana 6.5.4 Spark 2.4 Siddhi Rules 4.3.17 It also brings Read more…
Craig 5.2.1 Release We are happy to share the latest development, new features and stories coming together with the craig.5.2.1 release. First of all the craig 5.2.1 leverages Elastic 6.5, Kibana 6.5, Spark 2.4 and Storm 1.1.3 releases. As you can guess, that alone brings in a lot of new features. On Read more…
In the punch, we do not use logstash for high-performance logs parsing. Why is that? Mainly because logstash is nor easily scalable nor does it provide an end-to-end acknowledgment pattern. This is a serious lack because we cannot afford to lose logs whatever happens. We thus selected an alternative technology (apache storm) to Read more…
Punch Data Science Meetup When: on the 15th of October. Where: in Rennes at the Google atelier numérique. Organised as part of the Rennes Machine Learning Meetup /French Tech Speaker: Simon Grah from Thales Theresis Research Lab Topic: Maritime Traffic Anomaly Detection We are very happy to have Simon animate our next meetup in Rennes. Many Read more…
We have 5 git repositories, our documentation is automatically generated. We use only maven and git to build our complete packaging. Nothing tremendous. In order to build and keep track of things, here is what we do. Simply said, we like it.
The story of the punchplatform is worth having a look at. The punch team started small, is still very small, yet designed a platform that has now a great positioning because of the strength of its internal components (ElasticSearch, Kafka, Storm and Spark), and its unique value added. Part of Read more…