Analytics Suite for Piwik PRO

Piwik PRO was officially launched in September 2013 and initially provided platform maintenance, support, and custom software-development services to Piwik users, which were mainly large companies and governments.

In December of 2013, Piwik PRO launched it’s two core services, Piwik Cloud and Piwik Enterprise.

Piwik Cloud provides a cloud-based version of Piwik and access to Piwik PRO premium features, user training, and ongoing support and maintenance. Currently, Piwik Cloud has data centers in Germany and the United States to enable clients from both Europe and the US to comply with strict privacy and data ownership regulations.

Piwik Enterprise (now known as On-Premises) delivers premium features, user training, ongoing support and maintenance, and custom development services. As Piwik On-Premises is hosted on a company’s own servers, it provides 100% data ownership and complies with a number of international privacy compliance laws.

We noticed early on that many Piwik users, mainly large corporations and governments, were requesting specific features that were not available with the self-hosted version of Piwik.

In response, we developed a number of premium features in 2014 for both the cloud and on-premises versions to provide our clients with advanced reporting, admin, and customization capabilities.

2014 also saw the opening of our dedicated US sales office in New York, which would allow us to scale our operations in North America.

Throughout the middle and later months of 2014, we noticed strong demand for Piwik PRO’s On-Premises services from large corporations and governments, so our focus shifted towards intranet analytics.

Large corporations and governments rely heavily on intranet applications for their day-to-day operations, however, there are few solutions available that provide the analytical data and reports needed to obtain clear insights into areas such as usage, contributions, etc.

In light of this, we made the decision to create a new product offering (Intranet Analytics) comprised of a number of premium features designed to help corporations and governments gain analytics from their most commonly used intranet applications. The premium features we developed for the intranet product offering include:

SharePoint Analytics

Piwik PRO SharePoint Analytics lets organizations gain deeper insights into all usage areas within their SharePoint service. Based on the data and information displayed in Piwik, they’ll be able to discover how well their company leverages the intranet platform to meet current business and team objectives, and then set goals to improve them.

Confluence Analytics

Confluence integration allows companies to maximize the benefits to their team’s productivity offered by this collaborative platform. They can set goals, track events, and improve overall performance along with internal communication of their employees.

Due to Piwik’s strong user-privacy features and commitment to providing 100% data ownership, it is a very popular analytics solution in Germany (Piwik has about a 16% market share of websites using .de domains), where privacy and data ownership regulations are quite strict. However, there were many companies in Germany that required solutions not offered with the self-hosted version of Piwik.

In order to meet this demand for additional services, support, and consultation in Germany, we set up an office in Cologne.

As a business, we experienced consistent growth through 2013, 2014, and 2015, and as a result, became a validated business with a yearly turnover of more than $1 million.

Up until this point, we had been focusing a lot on our intranet analytics side of the business, but we noticed a rise in demand for marketing analytics tools and features.

To meet this demand, we developed a number of features and integrations to help marketers improve the performance of their campaigns and optimize their websites and mobile apps.

In 2016, we built and released a number of key marketing analytics features:

Piwik PRO tag manager

We built a tag-management system (TMS) and released it on an open-source license under the name 7tag in August 2015. In July 2016, we rebranded 7tag to Piwik PRO Tag Manager and made it proprietary software.

AdWords integration

As AdWords is one of the main channels used by online marketers, we built a feature that allows marketers to link their AdWords account with their Piwik PRO account. This integration allows them to gain additional metrics, create dedicated segments for their AdWords visitors, set AdWords campaign goals, and measure ROI.

Funnel Analytics

Customer funnels are a critical part of sales and marketing strategies, so we built a feature, known as Funnel Analytics, to help marketers and sales teams gain clearer insights into their customers’ journeys. Funnel Analytics allows them to gain clear visual representation of their funnels, view KPIs that show overall funnel performance, create and compare different customer segments, and identify and fix bottlenecks and areas where customers drop off (i.e. leave the funnel).

A/B Testing

Marketers now use a number of tools to test and optimize all areas of their website, so we developed an A/B Testing feature that provides them with a range of valuable metrics about their split tests from popular optimization tools, including Optimizely and VWO.

One key to the success of the A/B Testing feature was the use of synchronous tags. By using synchronous tags, we were able to eliminate the flash of original content (FOOC) issue, which is caused by asynchronous tags and results in the control (test A) briefly being shown before the variation (test B). Apart from delivering a poor user experience, FOOC also produces inaccurate analytics reports.

App Store Analytics

Apps are an important marketing tool for companies, so to help marketers gain insights into their apps, we built a feature known as App Store Analytics. This feature provides information about traffic sources, top referrals, and conversion rates for both Google Play and the Apple App Store.

Conversion Attribution

Piwik PRO’s Conversion Attribution modeling helps companies answer the most important questions about how their marketing channels work together to bring about conversions. They can discover what role website referrals, searches, and ads played in conversions and how to attribute conversions to marketing channels.

• One of the first main tasks we undertook on this project was optimising the backend and database. We redesigned the database structure to enable it to operate more effectively and to increase the process speed of the requests sent from the merchants’ sites.
• Our expertise in this field and our experience with similar projects enabled us to minimise the learning curve and reduce the time spent on planning the project. This allowed us to start developing the application straightaway and maintain a fast pace throughout the development process.
• We used mongoDB for the application’s database, which provides the stability, reliability and performance needed to support the many functions and user requests.

In March 2017, Piwik PRO raised a $2 million dollar Series A investment round led by Warsaw Equity Group and included a private investment from Tim Schumacher, co-founder and former CEO of Sedo.com and Chairman of Eyeo, the company behind Adblock Plus.

The next steps for Piwik PRO in 2017 are to further develop intranet and marketing analytics offerings. As part of the marketing analytics side of the business, we will be integrating a data-management platform (DMP) and a content personalization engine with Piwik PRO’s existing tools (the tag manager and analytics platform).

The DMP and content personalization engine were part of 7suite – a data-management stack that was designed and developed by Clearcode as a way to help our clients speed up their time to market and cut down on development costs.

Even though encountering technical problems is a regular occurrence when developing software, we were able to overcome a large majority of them and find solutions to challenging issues because of our experience in analytics development and our agile approach to software development.

However, there was one main technical challenge we faced with Piwik Cloud and it’s an issue that all SaaS vendors encounter: traffic.

As with most SaaS solutions, traffic dips and spikes at different times, meaning sometimes the servers need to handle and process tens of requests per second, and other times need to process hundreds of requests per second.

Below are the solutions we implemented to overcome the challenge of handling and processing large amounts of requests:

• High availability: We set up a redundant machine to avoid losing traffic in the event of hardware failure.
• Load balancing: To avoid performance issues in the event of a server going down, we set up multiple machines to handle tracking requests. It’s important to note that load balancing has to be implemented on both frontend machines as well as on MySQL databases. Although it sounds similar, the implementation is completely different.
• Made use of queue systems: We took advantage of queue systems that utilize RabbitMQ and Redis in order to handle traffic peaks and improve response times.
• Implemented multithreaded background data processing: This allows us to aggregate raw data and use the hardware’s power to its full potential.
• Tweaked the databases’ configuration: In order to utilize all available resources, we tweaked the settings in our databases, e.g. enabled compression.

1. Our experience in analytics and AdTech & MarTech development

Building advertising and marketing software and analytics tools requires a specific set of skills and first-hand industry experience. As we’ve been building software for the online and advertising industries and been providing custom development services based on Piwik since 2009, we were not only able to produce a clear scope of the project, but also avoid the steep learning curve that comes with building advertising, marketing, and analytics software.

2. Our incremental and agile approach to software development

Over the years, we’ve come to realize that there is one common theme with every project we’ve worked on – change is always inevitable. Every project has its own obstacles and unexpected issues that arise along the way, but the key to avoiding project failure is to adopt an agile and incremental approach to software development.

We applied our incremental and agile software development approach when designing and developing Piwik PRO’s features and integrations, which allowed us to built the features our clients really needed and make immediate changes based on their feedback.

3. Our previous success with launching new products for our clients and our own ventures

When it comes to releasing a new product, the actual development phase is only only one part of it. Selecting the right features for the MVP, identifying the core needs of the end users, understanding the problem the product is going to solve, and analyzing the market conditions all contribute to the success of the product.

Our 8+ years of experience in designing, building, and launching new AdTech and MarTech platforms for our clients, as well as for our own ventures, proved invaluable with the Piwik PRO project.

An example of this is evident with the Piwik PRO MVP. During the research and discovery phase of the project, we realized that a lot of users (typically large corporations and governments) of the open-source version of Piwik were searching for features and support services that weren’t available. This not only allowed us to launch an MVP that validated our initial assumptions (i.e. that users are willing to pay for more features and support services), but also enabled us to make gradual improvements to the product based on direct feedback from our initial clients.

Clearcode spun out Piwik PRO as a separate company in 2020.

Since then, Piwik PRO has emerged as one of the main alternatives to Google Analytics and has grown both its employee and client numbers.