In this guide, we will discuss Data Source Limit in AWS Quicksight. When you use different data sources in Quicksight tool, there are certain limits that apply based on data sources.
File
You can use up to 25GB of total size specified in manifest file. This limit is dependent on the file size after it is imported to SPICE.
The number of files supported in manifest file is 1000 and you also have some limit on number of columns in each file.
Table and Query
When you are querying a large table, it is recommended that you use Where or Having condition to reduce the number of data imported to SPICE. Query result imported into SPICE should not exceed 25 GB.
You can deselect some of the columns while importing the data into SPICE.
In case your data source contains data type which are not supported in Quicksight, AWS Quicksight skips those values.
| Person ID | Sales Date | Amount |
|---|---|---|
| 001 | 10/14/2017 | 12.43 |
| 002 | 5/3/2017 | 25.00 |
| 003 | Unknown | 18.17 |
| 004 | 3/8/2019 | 86.02 |
From the above values, Quicksight will drop the no date value row while importing this data in dataset. Following data types are supported in Quicksight −
| Database Source | Number Data Types | String Data Types | Date time Data Types | Boolean Data Types |
|---|---|---|---|---|
| Amazon Athena,Presto | bigintdecimaldoubleintegerrealsmallinttinyint | charvarchar | datetimestamp | Boolean |
| Amazon Aurora, MariaDB,and MySQL | bigintdecimaldoubleintintegermediumintnumericsmallinttinyint | charenumsettextvarchar | datedatetimetimestampyear | |
| PostgreSQL | bigintdecimaldoubleintegernumericprecisionrealsmallint | charcharactertextvarcharvarying character | datetimestamp | Boolean |
| Apache Spark | bigintdecimaldoubleintegerrealsmallinttinyint | varchar | datetimestamp | Boolean |
| Snowflake | bigintbyteintdecimaldoubledoubleprecisionfloatfloat4float8intintegernumbernumericrealsmallinttinyint | charcharacterstringtextvarchar | datedatetimetimetimestamptimestamp_* | Boolean |
| Microsoft SQL Server | bigintbitdecimalintmoneynumericrealsmallintsmallmoneytinyint | charncharnvarchartextvarchar | datedatetimedatetime2datetimeoffsetsmalldatetime | bit |
Next Topic : Click Here