Skip to main content
Research Standards

Research Methodology

Last updated: July 2026

Quick Answer

PilotStack produces software market research drawn from published pricing pages, our recorded dataset, vendor documentation, and publicly available review and analyst sources. Every research project follows a 6-stage process: question definition, data collection, analysis, review, publication, and updates. Each figure carries its source and the date it was collected.

TL;DR

  • Research draws from public pricing pages, our recorded dataset, vendor documentation, and public review and analyst sources
  • 6-stage process: question definition, data collection, analysis, review, publication, updates
  • Every published figure carries a source and a collection date
  • Pricing data recorded against vendor pricing pages at time of collection
  • All limitations and methodology notes published with each report

Key Takeaways

  • Each research project starts with a specific question before data collection begins
  • Data collected systematically with documented collection dates and methods for every data point
  • Pricing data includes multiple tiers and regions where available
  • Outliers are investigated and documented rather than smoothed away
  • Editorial review before publication, separate from data collection
  • Detailed methodology, sample sizes, and limitations published with every report
  • Research updated when significant market changes occur
  • Data visualizations include source attribution, collection dates, and accessible text alternatives

Beyond individual product reviews, PilotStack produces original research reports, market analyses, pricing benchmarks, and industry trend reports. This page documents how we conduct this research.

Data Collection

Our research draws from multiple data sources to ensure comprehensive and accurate findings:

  • Primary research: Pricing analysis from public pricing pages, feature comparison data recorded for our own coverage, and questions we receive from readers.
  • Secondary research: Publicly available user reviews on G2, Capterra, and TrustRadius; publicly available analyst reports; vendor-published case studies, whitepapers, and documentation; industry benchmarks from published sources.
  • Market data: Pricing information collected from vendor websites and public pricing pages, with the date it was read recorded alongside it. We collect pricing for multiple tiers and regions where available.

Research Process

1.Research Question Definition

Each research project begins with a specific research question or hypothesis aligned with our editorial mission. We define the scope, methodology, and data sources before data collection begins.

2.Data Collection

Data is collected systematically according to the project-specific methodology. For pricing research, we collect data from vendor websites, record the collection date and method for each data point where available.

3.Analysis & Validation

Data is analyzed using appropriate statistical methods where applicable. Material limitations, assumptions, and notable outliers are documented when relevant.

4.Peer Review

Every research report undergoes internal peer review by at least one researcher not involved in the original data collection. The reviewer evaluates methodology, data accuracy, and interpretation.

5.Publication & Transparency

Published research includes detailed methodology notes, data collection dates, sample sizes, and limitations. We clearly distinguish between findings supported by our data and interpretive analysis.

6.Updates

Research reports include publication dates and may be updated when significant changes or corrections warrant revision. Updates are noted with the date and nature of changes.

Data Quality Standards

  • All data points include source attribution and collection date
  • Pricing data is verified against vendor websites at the time of collection
  • Survey data includes documented sample sizes, methodologies, and margin of error where applicable
  • Secondary data sources are evaluated for recency, methodology quality, and potential bias
  • Data visualizations accurately represent underlying data with clear axis labels and source notes

Original Charts and Visualizations

Charts and data visualizations in our research reports are generated from the underlying datasets and source notes available for the report. Each chart includes:

  • Clear title and axis labels
  • Data source attribution with collection date
  • Methodology notes for complex visualizations
  • Accessible text alternatives for screen readers

Limitations

We acknowledge the following limitations in our research:

  • Pricing data reflects publicly available information and may not include enterprise discounts, negotiated pricing, or region-specific variations
  • User review data is aggregated from third-party platforms and reflects the opinions of their user bases, which may not be representative of all users
  • Market size and growth estimates are based on published analyst reports and may use different methodologies and definitions
  • Our research focuses primarily on English-language tools and North American/European markets

For questions about our research methodology, contact us at research@pilotstack.online.