diabetic-insights
How to Export Tidepool Data for Analysis in Diabeticlens
Table of Contents
Introduction: Why Export Tidepool Data for DiabeticLens?
Managing diabetes effectively relies on consistent data analysis. Tidepool serves as a central hub for logging blood glucose readings, insulin doses, and other diabetes-related metrics. DiabeticLens is an advanced analytics platform that transforms raw Tidepool data into actionable insights through visualizations and trend detection. Exporting your Tidepool data into DiabeticLens enables you to identify patterns that manual review might miss, optimize insulin dosing, and spot early signs of glycemic variability. This guide walks you through the entire export and import process, ensuring a seamless transition of your health data between these two powerful tools.
Tidepool stores data in a structured JSON format that includes timestamps, device metadata, and event types. DiabeticLens’s import engine is designed to parse this structure, preserving the integrity of your historical records. By the end of this tutorial, you will be able to regularly export data and leverage DiabeticLens’s reporting features to improve your diabetes self-management.
Understanding Tidepool’s Data Structure
Before exporting, it helps to understand what kind of data Tidepool stores and how DiabeticLens interprets it. Tidepool records:
- Blood glucose (BG) readings – from CGMs (continuous glucose monitors) and fingerstick meters.
- Insulin doses – boluses, basal rates, and pump settings.
- Carbohydrate intake – meal events with gram estimates.
- Device settings – pump profiles, sensor calibrations, and alerts.
- Notes and tags – exercise, illness, or stress markers.
DiabeticLens ingests these event types to generate statistical analyses, such as time-in-range reports, standard deviation charts, and daily profile overlays. The export format you choose directly affects the richness of the insights DiabeticLens can produce.
JSON vs. CSV: Which Export Format Works Best?
Tidepool offers two primary export formats: JSON and CSV. JSON (JavaScript Object Notation) is the native format for Tidepool’s internal data model. It retains nested relationships, such as the link between a bolus event and the carbohydrate intake that preceded it. CSV (comma-separated values) flattens the data, making it easier to open in spreadsheet applications but sacrificing some contextual linkages. For DiabeticLens, JSON is strongly recommended because the platform’s analysis engine is built to read Tidepool’s JSON schema directly. CSV import is supported as a fallback, but advanced features like insulin-on-board calculations and pump history charts may not work as reliably. Always default to JSON unless you have a specific reason to use CSV.
Preparing Your Tidepool Account for Export
To ensure a smooth export, take a few minutes to verify that your Tidepool account is synchronized and complete. Log in at https://tidepool.org and navigate to your data dashboard. Look for any gaps in the timeline – missing days or incomplete hourly readings can occur if a device was offline or if uploads were interrupted. Resolve these gaps by re-uploading data from your CGM or insulin pump before exporting. Also, check that all paired devices (e.g., a Dexcom receiver, Medtronic pump, or Abbott Libre reader) are listed under the “Devices” section. If a device is missing, connect it and import its data into Tidepool first. A fully populated account yields the most comprehensive analysis in DiabeticLens.
Step 1: Log into Tidepool and Access the Data Dashboard
Navigate to https://tidepool.org and click the “Login” button. Enter your email address and password. If you use two-factor authentication (2FA), complete that step as well. Once logged in, you land on the main dashboard, which displays a graphical overview of recent BG readings, insulin events, and time-in-range percentages. This dashboard is read-only; the export functionality lives under a separate menu.
Step 2: Find the Export Feature
Look for a gear icon or your profile avatar in the top-right corner of the page. Click on it to open the settings dropdown. Select “Data” or “Export Data” – the exact label may vary slightly depending on Tidepool’s current interface version. If you cannot see the option immediately, scroll to the bottom of the left-hand navigation panel; some older versions place “Export” under the “Tools” section. Alternatively, you can directly visit https://tidepool.org/export once logged in. The export page presents two main configuration controls: date range and file format.
Setting the Date Range
Tidepool defaults to exporting the last 90 days of data. To change this, click the date picker and select a custom start and end date. Best practice: export in overlapping chunks (e.g., three-month increments) if you have more than a year of data. This prevents the export file from becoming too large and ensures DiabeticLens can process it quickly. For annual reviews, choose a one-year range. If you are using DiabeticLens for retrospective analysis of a specific clinical trial or research study, limit the range to the relevant period.
Selecting the Export Format
On the same screen, you will see a radio button or dropdown labeled “File Format.” Choose “JSON” as your option. If the interface asks for a “Data Type” filter (e.g., BG, insulin, notes), leave all boxes checked to export everything. A comprehensive export gives DiabeticLens the full context needed for accurate analysis. Do not deselect any categories unless you are certain you will not need them later – you can always re-export with a narrower filter if the file size becomes unmanageable.
Step 3: Download the Export File
Click the “Export” button. Tidepool will process your request – this can take several seconds to a few minutes depending on the volume of data and current server load. A progress indicator may appear. Do not close the browser tab or navigate away while the export is generating. Once complete, your browser will prompt you to download a file named something like tidepool_export_YYYYMMDD_HHMMSS.json. Save it to a dedicated folder (e.g., “Diabetes Data Exports”) on your computer or cloud drive. Make a habit of including the date range in the filename to avoid confusion later: for example, tidepool_20240101_20240331.json.
What If the Download Doesn’t Start?
If the export button is unresponsive or the download does not begin, try the following troubleshooting steps:
- Clear your browser cache and cookies, then log in again.
- Disable ad blockers or privacy extensions temporarily, as they can interfere with download triggers.
- Switch to a different browser (Chrome, Firefox, Edge) and attempt the export again.
- Check Tidepool’s system status page at https://status.tidepool.org for any ongoing outages.
If the problem persists, contact Tidepool support via their help center. Many data export issues stem from account permission settings – ensure you are logged in as the primary account owner, not a sharee or clinician with limited export rights.
Step 4: Import Your Tidepool Data into DiabeticLens
Now that you have the JSON file on your computer, open a new browser tab and navigate to https://diabeticlens.com. If you already have an account, click “Sign In” and enter your credentials. If you are new to DiabeticLens, click “Create an Account” and follow the registration process. After logging in, you will see a dashboard with options to start a new analysis or upload data. Look for a button labeled “Import Data” or “Upload” – usually located in the top navigation bar or on the “My Data” page.
Uploading the File
Click the import button and navigate to the location of your JSON file. Select it and confirm the upload. DiabeticLens will automatically detect the Tidepool format and begin parsing the data. Depending on file size, this may take up to a minute. A progress bar shows the verification stage, where the system checks that all required fields (timestamps, BG values, insulin units) are present and formatted correctly. If any issues are found, DiabeticLens will display a warning message with details. For example, if the JSON file has duplicate entries or missing timestamps, you may need to re-export from Tidepool with a clean dataset. Once validation passes, the data is stored in your DiabeticLens account and is ready for analysis.
Linking Multiple Export Files
If you have exported data in several chunks (e.g., separate files for each quarter), you can upload them in sequence. DiabeticLens merges records by timestamp, automatically deduplicating entries with identical timestamps and event types. To ensure a clean merge, upload the oldest file first, then the next oldest, and so on. After each upload, use the “Preview” feature to verify that the timeline is continuous and that no overlapping data produced oddities like double-counted insulin doses. This layered import strategy is particularly useful when migrating historical data from years of Tidepool usage.
Step 5: Verify Your Data and Start Analyzing
After the import completes, DiabeticLens will present a summary screen showing the date range covered, number of BG readings, insulin events, and notes. It is critical to verify that the imported data matches your expectations. Compare the total number of BG readings against what Tidepool displayed on its dashboard for the same period. If the counts differ by more than a few percent, re-examine the export file for potential corruption or incomplete export. You can also look at a sample of raw events by clicking “View Raw Data” – this shows a table of the first hundred records, allowing you to spot anomalies like all-zero values or timestamps outside the expected range.
Using DiabeticLens’s Core Features
Once verified, you can explore DiabeticLens’s analytical tools. Common reports include:
- Time-in-range (TIR) pie chart – showing percentages of readings above, within, and below the target range (e.g., 70–180 mg/dL).
- Daily modal day overlay – plotting all BG readings on a 24-hour axis to visualize recurring patterns (e.g., post-breakfast spikes).
- Insulin-to-carbohydrate ratio analysis – comparing actual bolus doses with meal carbohydrate entries to evaluate dosing accuracy.
- Standard deviation and coefficient of variation – quantifying glycemic variability, a key predictor of hypoglycemia risk.
- Trend reports – monthly or weekly breakdowns of average BG, total daily insulin, and hypoglycemic events.
These reports are interactive – you can hover over data points for detailed tooltips, zoom into specific time periods, and export the visuals as images or PDFs for discussion with your healthcare provider.
Tips for a Successful and Ongoing Export Workflow
To make data export a routine part of your diabetes management, follow these best practices:
- Schedule regular exports – Mark a monthly calendar reminder to export from Tidepool and upload to DiabeticLens. Consistent data feeds yield more accurate long-term trend analysis.
- Back up your export files – Maintain a secure, organized folder structure. Name each file with the export date and range covered. Cloud storage (e.g., Google Drive, Dropbox) provides redundancy against local hard drive failures.
- Keep devices up to date – Ensure your CGM, insulin pump, and any other data sources are synced to Tidepool before exporting. A skipped upload day can break the continuity of your analysis.
- Use desktop browsers for large exports – Mobile browsers may time out or handle file downloads poorly. A computer with a wired internet connection provides the most reliable experience.
- Document changes in therapy – Add notes in Tidepool (or DiabeticLens directly) when you change insulin types, adjust basals, or start a new medication. These annotations help contextualize shifts in data patterns.
Common Issues and How to Resolve Them
Even with careful preparation, you may encounter hurdles. Below are frequent problems and their solutions:
“No data found” in DiabeticLens after import
This usually means the JSON file was empty or contained only metadata. Revisit Tidepool’s export page and ensure the date range covers a period when you actually used diabetes devices. Also check that your Tidepool account has uploaded data – sometimes device uploads fail silently. Redeploy the Tidepool Uploader application and confirm that new data appears on the Tidepool dashboard before exporting again.
Format mismatch errors
If DiabeticLens rejects your JSON file with a “format not recognized” message, the file might be corrupted or saved with a different extension (e.g., .json.txt). Verify the file extension is .json. Open the file with a text editor to confirm it starts with a curly brace { – if it contains HTML or a “page not found” message, the export session timed out and you need to re-export. Avoid manually editing the JSON file, as even a missing comma can break parsing.
Duplicate entries
Duplicate records can appear if you upload the same export file twice. DiabeticLens attempts to deduplicate, but if you see inflated BG counts, manually remove duplicates using a data cleaning tool or delete the import and re-upload a clean version. To avoid duplicates, label each import session clearly in your records.
Slow import or application lag
Exports spanning multiple years may produce files larger than 100 MB. DiabeticLens processes these on the server side, but performance can degrade. Split the export into smaller chunks (e.g., three-month intervals) and upload them one at a time. This also helps in pinpointing any segment that causes errors.
Why Analyze Tidepool Data in DiabeticLens?
Tidepool excels at data collection and sharing with clinicians, but its built-in analysis tools are relatively basic. DiabeticLens extends that capability with advanced statistical methods originally developed for research settings. By combining Tidepool’s robust data repository with DiabeticLens’s analytic engine, you gain a deeper understanding of your diabetes dynamics. For example, DiabeticLens can run sliding-window regression to detect slow drifts in insulin sensitivity, or generate risk scores for nocturnal hypoglycemia based on historical patterns. These insights are difficult to derive from manual spreadsheet analysis. The integration also allows you to overlay lab results (e.g., HbA1c) from other sources, giving a more complete picture of your metabolic health.
Beyond individual use, healthcare providers increasingly rely on platforms like DiabeticLens to remotely monitor patient populations. If you are a clinician, instructing patients to export their Tidepool data and upload it to DiabeticLens streamlines the review process. You can set up automated alerts when certain thresholds are breached (e.g., time-in-range drops below 50%). The time saved on data wrangling can be redirected toward direct patient support.
Conclusion
Exporting Tidepool data for analysis in DiabeticLens is a straightforward, repeatable process that unlocks powerful visualization and decision-support capabilities. By following the steps outlined in this guide – preparing your account, selecting the JSON export format, downloading the file, and importing it into DiabeticLens – you create a continuous loop of data-driven diabetes management. Regular exports ensure your insights stay current, helping you detect trends early and adjust therapy with confidence. Start today: log into Tidepool, export your latest data, and take the next step toward mastering your diabetes analytics with DiabeticLens.