If you are unable to create a new account, please email support@bspsoftware.com

 

News:

MetaManager - Administrative Tools for IBM Cognos
Pricing starting at $2,100
Download Now    Learn More

Main Menu

reading data through data module with Jupyter

Started by Eugene, 19 Mar 2021 06:31:52 AM

Previous topic - Next topic

Eugene

Deal all,

I have the following case:
I have a csv file. Then I want to read this file, through jupyter Notebook with python.

I use the following command in order to read the file: dataFrame=CADataConnector.read_data(parameters as described in the following section.

df_module = CADataConnector.read_data(path=".public_folders/Samples/By feature/Notebooks/Data/Source files/Airlines.csv", nrows=1000)

One of the arguments that the function can take is  nrows, which is optional.   
But there is a limitation as the manual says:  If omitted, the maximum number of rows returned is 10,000.

But If  I want  to read the whole file, without  knowing the size of it , I do not know what can I do.

I thought to pass a  huge value sush as, 9999999999999999999 but this is not something that I do not want to do.

Thanks in advance.