How to use HTreeMap to populate a List

up vote
1
down vote

favorite

I am trying to use HTreeMap from mapDB to populate a List of million entries in a CSV file, but every time I insert data into the List, the previous entry is overwritten for the HTreeMap.

The only way to avoid overwriting an HTreeMap in the final List of values is to create another DB connection of a hashmap, but with this solution, there is an exception of Java Heap Size.

Is there a subtle way to use HTreeMap in reading a million plus records and adding it to a List without duplicating the data?

public GapList<HTreeMap<String, Object>> fn_ReadCSV_GapListHTMap(File fileCSV) {



   BufferedReader bfrdrCSVReader = null;

   String strLine = "";

   String arrHeaders;



   //Gaplist is used for collecting the data read as map from the CSV.

   GapList<HTreeMap<String, Object>> glhtmapReadCSV = new GapList<>();

   try {



       bfrdrCSVReader = new BufferedReader(new FileReader(fileCSV));



       //reading header for the .csv file, which by default is the first line of file.

       String headerLine = bfrdrCSVReader.readLine();

       arrHeaders = headerLine.split(",");



       //using mapDB to read voluminous data from the CSV which is in tunes of a million.

        DB dbReadCSV = DBMaker.memoryDB().closeOnJvmShutdown().make();



        HTreeMap<String, Object> htmapLineData = (HTreeMap<String, Object>) dbReadCSV.hashMap("htmapLineData").keySerializer(Serializer.STRING).expireMaxSize(25).createOrOpen();



       //read each line of the .csv file.

       while((strLine = bfrdrCSVReader.readLine()) != null) {



           //intCSVLine ++;

           String arrTokens = strLine.split(",",-1);



           //When I used hashmap, I reset it here after adding the read data to

           //the list, but this type of behavior can't be done for HTreeMap.

           //Map<String, Object> mapLineData = new HashMap<>();



            //as stated in the problem statement, one needs to create new instance of DB

            //such that the new HTreeMap initialized later points to new memory location

            //and when finally added to the list, doesn't duplicate the data in the list.

            dbReadCSV = DBMaker.memoryDB().closeOnJvmShutdown().make();



            HTreeMap<String, Object> htmapLineData = (HTreeMap<String, Object>) dbReadCSV.hashMap("htmapLineData").keySerializer(Serializer.STRING).expireMaxSize(25).createOrOpen();



           for(int intLineNum = 0; intLineNum < arrHeaders.length; intLineNum++) {



               //based on the header read, read each value for that header & add to the map.

               htmapLineData.put(arrHeaders[intLineNum].trim(), arrTokens[intLineNum].trim());

           }

           //once a map for a line read is created, add it to the final list of entries.

           glhtmapReadCSV.add(htmapLineData);



           //The below code creates an issue wherein the entire DB connection is closed

           //and the error states it to be "com.sun.jdi.InvocationException occurred invoking method."

           //resulting into a corrupt list of data.



           //closing the DBMaker to enable refreshing of the HTreeMap.

           //dbReadCSV.close();

       }



       bfrdrCSVReader.close();

   }

   catch(Exception exceptionCSVReader) {       



       StringWriter stack = new StringWriter();

       exceptionCSVReader.printStackTrace(new PrintWriter(stack));

       log.debug("DEBUG: The exception while reading CSV file is: "+stack);

       assertTrue(false, "ERROR: CSV file can't be read; hence exiting with exception !");

   }



   return glhtmapReadCSV;

}

The exception reported while executing the above code is as follows.
P.S.: The utility.CSVHandler.fn_ReadCSV_GapListHTMap is a custom class designed by me.

The exception while reading CSV file is: org.mapdb.DBException$OutOfMemory: Java heap space

    at org.mapdb.volume.ByteArrayVol.ensureAvailable(ByteArrayVol.java:98)

    at org.mapdb.StoreDirect.<init>(StoreDirect.kt:94)

    at org.mapdb.StoreDirect$Companion.make(StoreDirect.kt:57)

    at org.mapdb.StoreDirect$Companion.make$default(StoreDirect.kt:56)

    at org.mapdb.StoreDirect.compact(StoreDirect.kt:756)

    at utility.CSVHandler.fn_ReadCSV_GapListHTMap(CSVHandler.java:292)

    at appModules.Src1_Src2_Comparision_Functions.fn_CompareQlikSources(Src1_Src2_Comparision_Functions.java:695)

    at testCasesQlik.testCSVHandler.fn_testCSV(testCSVHandler.java:81)

    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

    at java.lang.reflect.Method.invoke(Method.java:498)

    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)

    at org.testng.internal.Invoker.invokeMethod(Invoker.java:583)

    at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:719)

    at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:989)

    at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)

    at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)

    at org.testng.TestRunner.privateRun(TestRunner.java:648)

    at org.testng.TestRunner.run(TestRunner.java:505)

    at org.testng.SuiteRunner.runTest(SuiteRunner.java:455)

    at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450)

    at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415)

    at org.testng.SuiteRunner.run(SuiteRunner.java:364)

    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)

    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84)

    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1208)

    at org.testng.TestNG.runSuitesLocally(TestNG.java:1137)

    at org.testng.TestNG.runSuites(TestNG.java:1049)

    at org.testng.TestNG.run(TestNG.java:1017)

    at org.testng.remote.AbstractRemoteTestNG.run(AbstractRemoteTestNG.java:114)

    at org.testng.remote.RemoteTestNG.initAndRun(RemoteTestNG.java:251)

    at org.testng.remote.RemoteTestNG.main(RemoteTestNG.java:77)

Caused by: java.lang.OutOfMemoryError: Java heap space

java list mapdb

share|improve this question

edited yesterday

asked 2 days ago

Aashish

112

New contributor

Aashish is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

• 
  
  
  

  
  

  
  
  
  
  
  

  
  Welcome to Stack Overflow! You should consider adding the code you are using, as well as potentially the exception you are encountering so that others can see what you have tried and suggest a solution. You can do this by pressing the edit button under your post. Also format any code you post by selecting it and pressing the { } button.
  – Mihai Chelaru
  2 days ago
  
  
  

  
  
  
  


• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  @MihaiChelaru, modified the contents as requested. Thanks for your suggestions. I hope the data helps you guide me to a solution. Thanks.
  – Aashish
  yesterday
  
  
  

  
  
  
  

add a comment | 

up vote
1
down vote

favorite

I am trying to use HTreeMap from mapDB to populate a List of million entries in a CSV file, but every time I insert data into the List, the previous entry is overwritten for the HTreeMap.

The only way to avoid overwriting an HTreeMap in the final List of values is to create another DB connection of a hashmap, but with this solution, there is an exception of Java Heap Size.

Is there a subtle way to use HTreeMap in reading a million plus records and adding it to a List without duplicating the data?

public GapList<HTreeMap<String, Object>> fn_ReadCSV_GapListHTMap(File fileCSV) {



   BufferedReader bfrdrCSVReader = null;

   String strLine = "";

   String arrHeaders;



   //Gaplist is used for collecting the data read as map from the CSV.

   GapList<HTreeMap<String, Object>> glhtmapReadCSV = new GapList<>();

   try {



       bfrdrCSVReader = new BufferedReader(new FileReader(fileCSV));



       //reading header for the .csv file, which by default is the first line of file.

       String headerLine = bfrdrCSVReader.readLine();

       arrHeaders = headerLine.split(",");



       //using mapDB to read voluminous data from the CSV which is in tunes of a million.

        DB dbReadCSV = DBMaker.memoryDB().closeOnJvmShutdown().make();



        HTreeMap<String, Object> htmapLineData = (HTreeMap<String, Object>) dbReadCSV.hashMap("htmapLineData").keySerializer(Serializer.STRING).expireMaxSize(25).createOrOpen();



       //read each line of the .csv file.

       while((strLine = bfrdrCSVReader.readLine()) != null) {



           //intCSVLine ++;

           String arrTokens = strLine.split(",",-1);



           //When I used hashmap, I reset it here after adding the read data to

           //the list, but this type of behavior can't be done for HTreeMap.

           //Map<String, Object> mapLineData = new HashMap<>();



            //as stated in the problem statement, one needs to create new instance of DB

            //such that the new HTreeMap initialized later points to new memory location

            //and when finally added to the list, doesn't duplicate the data in the list.

            dbReadCSV = DBMaker.memoryDB().closeOnJvmShutdown().make();



            HTreeMap<String, Object> htmapLineData = (HTreeMap<String, Object>) dbReadCSV.hashMap("htmapLineData").keySerializer(Serializer.STRING).expireMaxSize(25).createOrOpen();



           for(int intLineNum = 0; intLineNum < arrHeaders.length; intLineNum++) {



               //based on the header read, read each value for that header & add to the map.

               htmapLineData.put(arrHeaders[intLineNum].trim(), arrTokens[intLineNum].trim());

           }

           //once a map for a line read is created, add it to the final list of entries.

           glhtmapReadCSV.add(htmapLineData);



           //The below code creates an issue wherein the entire DB connection is closed

           //and the error states it to be "com.sun.jdi.InvocationException occurred invoking method."

           //resulting into a corrupt list of data.



           //closing the DBMaker to enable refreshing of the HTreeMap.

           //dbReadCSV.close();

       }



       bfrdrCSVReader.close();

   }

   catch(Exception exceptionCSVReader) {       



       StringWriter stack = new StringWriter();

       exceptionCSVReader.printStackTrace(new PrintWriter(stack));

       log.debug("DEBUG: The exception while reading CSV file is: "+stack);

       assertTrue(false, "ERROR: CSV file can't be read; hence exiting with exception !");

   }



   return glhtmapReadCSV;

}

The exception reported while executing the above code is as follows.
P.S.: The utility.CSVHandler.fn_ReadCSV_GapListHTMap is a custom class designed by me.

The exception while reading CSV file is: org.mapdb.DBException$OutOfMemory: Java heap space

    at org.mapdb.volume.ByteArrayVol.ensureAvailable(ByteArrayVol.java:98)

    at org.mapdb.StoreDirect.<init>(StoreDirect.kt:94)

    at org.mapdb.StoreDirect$Companion.make(StoreDirect.kt:57)

    at org.mapdb.StoreDirect$Companion.make$default(StoreDirect.kt:56)

    at org.mapdb.StoreDirect.compact(StoreDirect.kt:756)

    at utility.CSVHandler.fn_ReadCSV_GapListHTMap(CSVHandler.java:292)

    at appModules.Src1_Src2_Comparision_Functions.fn_CompareQlikSources(Src1_Src2_Comparision_Functions.java:695)

    at testCasesQlik.testCSVHandler.fn_testCSV(testCSVHandler.java:81)

    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

    at java.lang.reflect.Method.invoke(Method.java:498)

    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)

    at org.testng.internal.Invoker.invokeMethod(Invoker.java:583)

    at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:719)

    at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:989)

    at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)

    at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)

    at org.testng.TestRunner.privateRun(TestRunner.java:648)

    at org.testng.TestRunner.run(TestRunner.java:505)

    at org.testng.SuiteRunner.runTest(SuiteRunner.java:455)

    at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450)

    at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415)

    at org.testng.SuiteRunner.run(SuiteRunner.java:364)

    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)

    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84)

    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1208)

    at org.testng.TestNG.runSuitesLocally(TestNG.java:1137)

    at org.testng.TestNG.runSuites(TestNG.java:1049)

    at org.testng.TestNG.run(TestNG.java:1017)

    at org.testng.remote.AbstractRemoteTestNG.run(AbstractRemoteTestNG.java:114)

    at org.testng.remote.RemoteTestNG.initAndRun(RemoteTestNG.java:251)

    at org.testng.remote.RemoteTestNG.main(RemoteTestNG.java:77)

Caused by: java.lang.OutOfMemoryError: Java heap space

java list mapdb

share|improve this question

edited yesterday

asked 2 days ago

Aashish

112

New contributor

Aashish is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

• 
  
  
  

  
  

  
  
  
  
  
  

  
  Welcome to Stack Overflow! You should consider adding the code you are using, as well as potentially the exception you are encountering so that others can see what you have tried and suggest a solution. You can do this by pressing the edit button under your post. Also format any code you post by selecting it and pressing the { } button.
  – Mihai Chelaru
  2 days ago
  
  
  

  
  
  
  


• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  @MihaiChelaru, modified the contents as requested. Thanks for your suggestions. I hope the data helps you guide me to a solution. Thanks.
  – Aashish
  yesterday
  
  
  

  
  
  
  

add a comment | 

up vote
1
down vote

favorite

up vote
1
down vote

favorite

I am trying to use HTreeMap from mapDB to populate a List of million entries in a CSV file, but every time I insert data into the List, the previous entry is overwritten for the HTreeMap.

The only way to avoid overwriting an HTreeMap in the final List of values is to create another DB connection of a hashmap, but with this solution, there is an exception of Java Heap Size.

Is there a subtle way to use HTreeMap in reading a million plus records and adding it to a List without duplicating the data?

public GapList<HTreeMap<String, Object>> fn_ReadCSV_GapListHTMap(File fileCSV) {



   BufferedReader bfrdrCSVReader = null;

   String strLine = "";

   String arrHeaders;



   //Gaplist is used for collecting the data read as map from the CSV.

   GapList<HTreeMap<String, Object>> glhtmapReadCSV = new GapList<>();

   try {



       bfrdrCSVReader = new BufferedReader(new FileReader(fileCSV));



       //reading header for the .csv file, which by default is the first line of file.

       String headerLine = bfrdrCSVReader.readLine();

       arrHeaders = headerLine.split(",");



       //using mapDB to read voluminous data from the CSV which is in tunes of a million.

        DB dbReadCSV = DBMaker.memoryDB().closeOnJvmShutdown().make();



        HTreeMap<String, Object> htmapLineData = (HTreeMap<String, Object>) dbReadCSV.hashMap("htmapLineData").keySerializer(Serializer.STRING).expireMaxSize(25).createOrOpen();



       //read each line of the .csv file.

       while((strLine = bfrdrCSVReader.readLine()) != null) {



           //intCSVLine ++;

           String arrTokens = strLine.split(",",-1);



           //When I used hashmap, I reset it here after adding the read data to

           //the list, but this type of behavior can't be done for HTreeMap.

           //Map<String, Object> mapLineData = new HashMap<>();



            //as stated in the problem statement, one needs to create new instance of DB

            //such that the new HTreeMap initialized later points to new memory location

            //and when finally added to the list, doesn't duplicate the data in the list.

            dbReadCSV = DBMaker.memoryDB().closeOnJvmShutdown().make();



            HTreeMap<String, Object> htmapLineData = (HTreeMap<String, Object>) dbReadCSV.hashMap("htmapLineData").keySerializer(Serializer.STRING).expireMaxSize(25).createOrOpen();



           for(int intLineNum = 0; intLineNum < arrHeaders.length; intLineNum++) {



               //based on the header read, read each value for that header & add to the map.

               htmapLineData.put(arrHeaders[intLineNum].trim(), arrTokens[intLineNum].trim());

           }

           //once a map for a line read is created, add it to the final list of entries.

           glhtmapReadCSV.add(htmapLineData);



           //The below code creates an issue wherein the entire DB connection is closed

           //and the error states it to be "com.sun.jdi.InvocationException occurred invoking method."

           //resulting into a corrupt list of data.



           //closing the DBMaker to enable refreshing of the HTreeMap.

           //dbReadCSV.close();

       }



       bfrdrCSVReader.close();

   }

   catch(Exception exceptionCSVReader) {       



       StringWriter stack = new StringWriter();

       exceptionCSVReader.printStackTrace(new PrintWriter(stack));

       log.debug("DEBUG: The exception while reading CSV file is: "+stack);

       assertTrue(false, "ERROR: CSV file can't be read; hence exiting with exception !");

   }



   return glhtmapReadCSV;

}

The exception reported while executing the above code is as follows.
P.S.: The utility.CSVHandler.fn_ReadCSV_GapListHTMap is a custom class designed by me.

The exception while reading CSV file is: org.mapdb.DBException$OutOfMemory: Java heap space

    at org.mapdb.volume.ByteArrayVol.ensureAvailable(ByteArrayVol.java:98)

    at org.mapdb.StoreDirect.<init>(StoreDirect.kt:94)

    at org.mapdb.StoreDirect$Companion.make(StoreDirect.kt:57)

    at org.mapdb.StoreDirect$Companion.make$default(StoreDirect.kt:56)

    at org.mapdb.StoreDirect.compact(StoreDirect.kt:756)

    at utility.CSVHandler.fn_ReadCSV_GapListHTMap(CSVHandler.java:292)

    at appModules.Src1_Src2_Comparision_Functions.fn_CompareQlikSources(Src1_Src2_Comparision_Functions.java:695)

    at testCasesQlik.testCSVHandler.fn_testCSV(testCSVHandler.java:81)

    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

    at java.lang.reflect.Method.invoke(Method.java:498)

    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)

    at org.testng.internal.Invoker.invokeMethod(Invoker.java:583)

    at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:719)

    at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:989)

    at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)

    at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)

    at org.testng.TestRunner.privateRun(TestRunner.java:648)

    at org.testng.TestRunner.run(TestRunner.java:505)

    at org.testng.SuiteRunner.runTest(SuiteRunner.java:455)

    at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450)

    at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415)

    at org.testng.SuiteRunner.run(SuiteRunner.java:364)

    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)

    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84)

    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1208)

    at org.testng.TestNG.runSuitesLocally(TestNG.java:1137)

    at org.testng.TestNG.runSuites(TestNG.java:1049)

    at org.testng.TestNG.run(TestNG.java:1017)

    at org.testng.remote.AbstractRemoteTestNG.run(AbstractRemoteTestNG.java:114)

    at org.testng.remote.RemoteTestNG.initAndRun(RemoteTestNG.java:251)

    at org.testng.remote.RemoteTestNG.main(RemoteTestNG.java:77)

Caused by: java.lang.OutOfMemoryError: Java heap space

java list mapdb

share|improve this question

edited yesterday

asked 2 days ago

Aashish

112

New contributor

Aashish is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

I am trying to use HTreeMap from mapDB to populate a List of million entries in a CSV file, but every time I insert data into the List, the previous entry is overwritten for the HTreeMap.

The only way to avoid overwriting an HTreeMap in the final List of values is to create another DB connection of a hashmap, but with this solution, there is an exception of Java Heap Size.

Is there a subtle way to use HTreeMap in reading a million plus records and adding it to a List without duplicating the data?

public GapList<HTreeMap<String, Object>> fn_ReadCSV_GapListHTMap(File fileCSV) {



   BufferedReader bfrdrCSVReader = null;

   String strLine = "";

   String arrHeaders;



   //Gaplist is used for collecting the data read as map from the CSV.

   GapList<HTreeMap<String, Object>> glhtmapReadCSV = new GapList<>();

   try {



       bfrdrCSVReader = new BufferedReader(new FileReader(fileCSV));



       //reading header for the .csv file, which by default is the first line of file.

       String headerLine = bfrdrCSVReader.readLine();

       arrHeaders = headerLine.split(",");



       //using mapDB to read voluminous data from the CSV which is in tunes of a million.

        DB dbReadCSV = DBMaker.memoryDB().closeOnJvmShutdown().make();



        HTreeMap<String, Object> htmapLineData = (HTreeMap<String, Object>) dbReadCSV.hashMap("htmapLineData").keySerializer(Serializer.STRING).expireMaxSize(25).createOrOpen();



       //read each line of the .csv file.

       while((strLine = bfrdrCSVReader.readLine()) != null) {



           //intCSVLine ++;

           String arrTokens = strLine.split(",",-1);



           //When I used hashmap, I reset it here after adding the read data to

           //the list, but this type of behavior can't be done for HTreeMap.

           //Map<String, Object> mapLineData = new HashMap<>();



            //as stated in the problem statement, one needs to create new instance of DB

            //such that the new HTreeMap initialized later points to new memory location

            //and when finally added to the list, doesn't duplicate the data in the list.

            dbReadCSV = DBMaker.memoryDB().closeOnJvmShutdown().make();



            HTreeMap<String, Object> htmapLineData = (HTreeMap<String, Object>) dbReadCSV.hashMap("htmapLineData").keySerializer(Serializer.STRING).expireMaxSize(25).createOrOpen();



           for(int intLineNum = 0; intLineNum < arrHeaders.length; intLineNum++) {



               //based on the header read, read each value for that header & add to the map.

               htmapLineData.put(arrHeaders[intLineNum].trim(), arrTokens[intLineNum].trim());

           }

           //once a map for a line read is created, add it to the final list of entries.

           glhtmapReadCSV.add(htmapLineData);



           //The below code creates an issue wherein the entire DB connection is closed

           //and the error states it to be "com.sun.jdi.InvocationException occurred invoking method."

           //resulting into a corrupt list of data.



           //closing the DBMaker to enable refreshing of the HTreeMap.

           //dbReadCSV.close();

       }



       bfrdrCSVReader.close();

   }

   catch(Exception exceptionCSVReader) {       



       StringWriter stack = new StringWriter();

       exceptionCSVReader.printStackTrace(new PrintWriter(stack));

       log.debug("DEBUG: The exception while reading CSV file is: "+stack);

       assertTrue(false, "ERROR: CSV file can't be read; hence exiting with exception !");

   }



   return glhtmapReadCSV;

}

The exception reported while executing the above code is as follows.
P.S.: The utility.CSVHandler.fn_ReadCSV_GapListHTMap is a custom class designed by me.

The exception while reading CSV file is: org.mapdb.DBException$OutOfMemory: Java heap space

    at org.mapdb.volume.ByteArrayVol.ensureAvailable(ByteArrayVol.java:98)

    at org.mapdb.StoreDirect.<init>(StoreDirect.kt:94)

    at org.mapdb.StoreDirect$Companion.make(StoreDirect.kt:57)

    at org.mapdb.StoreDirect$Companion.make$default(StoreDirect.kt:56)

    at org.mapdb.StoreDirect.compact(StoreDirect.kt:756)

    at utility.CSVHandler.fn_ReadCSV_GapListHTMap(CSVHandler.java:292)

    at appModules.Src1_Src2_Comparision_Functions.fn_CompareQlikSources(Src1_Src2_Comparision_Functions.java:695)

    at testCasesQlik.testCSVHandler.fn_testCSV(testCSVHandler.java:81)

    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

    at java.lang.reflect.Method.invoke(Method.java:498)

    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)

    at org.testng.internal.Invoker.invokeMethod(Invoker.java:583)

    at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:719)

    at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:989)

    at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)

    at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)

    at org.testng.TestRunner.privateRun(TestRunner.java:648)

    at org.testng.TestRunner.run(TestRunner.java:505)

    at org.testng.SuiteRunner.runTest(SuiteRunner.java:455)

    at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450)

    at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415)

    at org.testng.SuiteRunner.run(SuiteRunner.java:364)

    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)

    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84)

    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1208)

    at org.testng.TestNG.runSuitesLocally(TestNG.java:1137)

    at org.testng.TestNG.runSuites(TestNG.java:1049)

    at org.testng.TestNG.run(TestNG.java:1017)

    at org.testng.remote.AbstractRemoteTestNG.run(AbstractRemoteTestNG.java:114)

    at org.testng.remote.RemoteTestNG.initAndRun(RemoteTestNG.java:251)

    at org.testng.remote.RemoteTestNG.main(RemoteTestNG.java:77)

Caused by: java.lang.OutOfMemoryError: Java heap space

java list mapdb

java list mapdb

share|improve this question

edited yesterday

asked 2 days ago

Aashish

112

New contributor

Aashish is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

share|improve this question

edited yesterday

asked 2 days ago

Aashish

112

New contributor

Aashish is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

share|improve this question

share|improve this question

edited yesterday

edited yesterday

edited yesterday

asked 2 days ago

Aashish

112

New contributor

Aashish is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

asked 2 days ago

Aashish

112

asked 2 days ago

Aashish

112

112

New contributor

Aashish is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

New contributor

Aashish is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

Aashish is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

• 
  
  
  

  
  

  
  
  
  
  
  

  
  Welcome to Stack Overflow! You should consider adding the code you are using, as well as potentially the exception you are encountering so that others can see what you have tried and suggest a solution. You can do this by pressing the edit button under your post. Also format any code you post by selecting it and pressing the { } button.
  – Mihai Chelaru
  2 days ago
  
  
  

  
  
  
  


• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  @MihaiChelaru, modified the contents as requested. Thanks for your suggestions. I hope the data helps you guide me to a solution. Thanks.
  – Aashish
  yesterday
  
  
  

  
  
  
  

add a comment | 

• 
  
  
  

  
  

  
  
  
  
  
  

  
  Welcome to Stack Overflow! You should consider adding the code you are using, as well as potentially the exception you are encountering so that others can see what you have tried and suggest a solution. You can do this by pressing the edit button under your post. Also format any code you post by selecting it and pressing the { } button.
  – Mihai Chelaru
  2 days ago
  
  
  

  
  
  
  


• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  @MihaiChelaru, modified the contents as requested. Thanks for your suggestions. I hope the data helps you guide me to a solution. Thanks.
  – Aashish
  yesterday
  
  
  

  
  
  
  

Welcome to Stack Overflow! You should consider adding the code you are using, as well as potentially the exception you are encountering so that others can see what you have tried and suggest a solution. You can do this by pressing the edit button under your post. Also format any code you post by selecting it and pressing the { } button.
– Mihai Chelaru
2 days ago

Welcome to Stack Overflow! You should consider adding the code you are using, as well as potentially the exception you are encountering so that others can see what you have tried and suggest a solution. You can do this by pressing the edit button under your post. Also format any code you post by selecting it and pressing the { } button.
– Mihai Chelaru
2 days ago

1

1

@MihaiChelaru, modified the contents as requested. Thanks for your suggestions. I hope the data helps you guide me to a solution. Thanks.
– Aashish
yesterday

@MihaiChelaru, modified the contents as requested. Thanks for your suggestions. I hope the data helps you guide me to a solution. Thanks.
– Aashish
yesterday

add a comment | 

active

oldest

votes

Your Answer

StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});

Aashish is a new contributor. Be nice, and check out our Code of Conduct.

 

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53373399%2fhow-to-use-htreemap-to-populate-a-list%23new-answer', 'question_page');
}
);

Post as a guest

Name

Email

Required, but never shown

active

oldest

votes

active

oldest

votes

active

oldest

votes

active

oldest

votes

Aashish is a new contributor. Be nice, and check out our Code of Conduct.

 

draft saved

draft discarded

Aashish is a new contributor. Be nice, and check out our Code of Conduct.

Aashish is a new contributor. Be nice, and check out our Code of Conduct.

Aashish is a new contributor. Be nice, and check out our Code of Conduct.

 

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53373399%2fhow-to-use-htreemap-to-populate-a-list%23new-answer', 'question_page');
}
);

Post as a guest

Name

Email

Required, but never shown

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

Name

Name

Email

Required, but never shown

Email

Required, but never shown

Email

Required, but never shown

Email

Required, but never shown

Name

Name

Email

Required, but never shown

Email

Required, but never shown

Email

Required, but never shown

Email

Required, but never shown

This page is only for reference, If you need detailed information, please check here