Splitting A Large File Into Two And Mining The Data

Apr 17, 2008

I've been scouring the Internet for a few days now trying to get a macro working with varying degrees of success. It's driving me mad and I'm really hoping that someone out there can help me out. I'm trying to write a macro that will ...

1. Take a .xls file

2. Split the file in two

3. Take cells B2:B11 and paste them in to a csv file (to be called Upload1.csv) using the rows as column headers (i.e. B2:B11 now become A1:J1)

4. Take cells A13-J13 downwards (this file will have different numbers of rows each time it's generated) and paste them into a different csv file (to be called Upload2.csv) populating all the rows (except all rows in column I which are to be left blank) and all rows in Column J which are to contain the info in cell B7 of the original document.

5. In cell B11 of the original document I must only take the information that says MyAddress:xxxxx and discard all the other info

6. I must also loop through the second document until I find the words Total and copy everything UNTIL that row into the new document.

I know this probably sounds pretty awkward but in practice it's not that difficult to understand, it's probably the way that I've explained it

So far I've managed to take the original document and split it, populate both CSV files but I'm having problems with looping the macro until it sees the word Total and discards it and also populating the appropriate rows with the info from B7 ... I don't know how to make it populate only the rows that have info on them.

I've attached the original Excel file that is generated and also my attempt at the 2 csv files. I've also written in RED what needs to go where in each document.

View 14 Replies


ADVERTISEMENT

Import Large Text File Of Numbers Without Excel Splitting Numbers?

Jul 19, 2014

I have a text file with rows and columns of numbers ranging from 1-4 digits that I'd like to import/copy into Excel with each number being in its own cell. But whenever I copy/try to import, Excel splits all of the 3-4 digit numbers up into single digit numbers. The text file has 10,000+ columns (each number occupies two columns so I have half of that amount in numbers) and 300+ lines.

Is the file simply too large for Excel to handle or is there a way I can do this?

View 14 Replies View Related

Splitting Document To Mine Data And Create CSV File

Jun 5, 2008

I've got an Excel document that is generated from a third party programme (See ExcelDoc attached) ....

View 9 Replies View Related

Splitting Large Numbers Into Groups (LATITUDE AND LONGITUDE)

Nov 16, 2009

I have a spreadsheet with a column of Longitude values like:
A
172828.383E

I want to somehow split the cell into new individual cells so it will be like this:

A B C
17 28 28.383

View 5 Replies View Related

Data Mining

Dec 11, 2008

I have an excel spreadsheet that has the following type of data in the cells:
"11/09/08 20:29 JDS David/DBLD reports lights in the canopy are not working Christine/CBRE b4957204-1"

I need to know if there is a way to mine the B4957204-1 out of this, I have 300 cells with similiar text in that I need just a list of call #'s out of without all the other dribble.

View 14 Replies View Related

Splitting Large Table Into Separate Worksheets Keeping Format Same

Apr 26, 2013

I have 2 large XLS sheets that need to be split into seperate sheets.

The first is only 5 columns wide but the amount of rows changes day to day.

The second is a maximum of 7 columns wide and again the amount of rows will change.

I'm hoping for a VBA code to be able to do both on seperate books.

The A Column has the name of the company, and this can include (/,&) that will need to be removed, the names can also exceed 31 characters.
I would like to seperate the sheets by the company name and have the name appear as the sheet name.

Also the formatting from the master sheet to be copied to the resulting sheets, with a header row.

I have included the data for the larger of the two workbooks. data.jpg I have to pull the smaller report each day and the larger report each week.

View 3 Replies View Related

Data Mining / Extraction From Web

Nov 15, 2011

There are websites available for data, but what is viable and crucial to me is finding a way to

1) Run a repeated process via a macro / vba script to allow for data input into the site
2) Once input into site, data is to be brought back into excel so that I can benchmark my product pricing vs my competition

There are 2 sites I am most interested in getting this information from specifically and although they do the same thing they have a couple of unique pros to them. they are the following

1) Findchips.com
2) eciaauthorized.com

The biggest pro to findchips.com is that they have a beta tool on their site that allows for "mass searches" to be performed as opposed to 1 part number at a time. Up to 100 results can be returned at a time, so although there would be multiple iterations doing it this way would save processing power as each step is not done line by line (p/n by p/n) as i could group them and send them and perform the operations that way.

View 9 Replies View Related

Data Mining Multiple Workbooks

Jan 10, 2008

Engineering has given me 300 separate 2003 Excel Files. Each of these individual Excel files contains data I need for creating a list I have been tasked to do. Cells E3, K1, A6 and J2 in each Excel file contain the data I need for my list. Rather than manually data mining 300 separate Excel files for data I need from Cells E3, K1, A6 and J2, can this be done automatically with a macro?

I'm seeking for the Macro to automatically OPEN each individual Excel file, then copy the data from Cells E3, K1, A6, J2, and then paste this data into a list file with four columns. After the pasting is done, the macro will close the source data Excel file and move on to the next one. In the future I will have to repeat this task with probably 400 individual Excel files. Therefore, it will be great if the Macro didn't care how many Excel files required data mining.

View 4 Replies View Related

Lookup Data From Large Csv File

Jan 21, 2010

I want to use the attached Test.xls file below and do a lookup from the Data.csv (see zip file) where "Empl ID" (column A in Test.xls) matches "ID" (column A in Data.csv). I want to bring back "SupvID" (column B in Data.csv) into column D in Test.xls.

The problem I have is that in real life Data.csv is a very large file and contains more than Excel's maximum number of rows. I want to automate this using VBA to lookup the values without opening the csv file.

I have looked at a number of forums for answers and I can see where using an ADO connection will probably help accomplish this, but I can't seem to get it to work on these specific files.

View 4 Replies View Related

Little Data Saves As A Large File

Jan 9, 2008

I have some spreadsheets one worksheet little data and it saved as it a 5MB file when it should only save as something like 500Kb, what would cause this?

View 3 Replies View Related

Large CSV File: Too Large To Open. Split

Aug 6, 2003

I've got a 80 Mb CSV file and would like to open and work with it. Too many lines (90000 or so).

Is there a way to split ( ) this file so I can open two files instead?

View 9 Replies View Related

Macro Formula To Clean Data In Large File?

Mar 3, 2014

I am trying to use excel tools to clean dirty data and compare the two cells. The information is there but tainted with additional information that is not relevant. I have tried to use Left/Right tools to capture alpha characters leading an address number with no real success. Also, when I get the data it seems to have some embedded breaks that I can't seem to get rid of that cause my tasks to error too.

View 4 Replies View Related

Splitting Up An Excel File By Rows

Nov 24, 2008

I am trying to split up an excel file that has 18000 lines, i want to break this into groups of 100 lines and retain the original header info on line one for each file. Is this possible to do with a macro. I have NO experience with macros of programming so go easy on me. It would be great if it could autosave as book 1 book 2 book 3 or whatever, file name doesn't matter that much.

View 9 Replies View Related

Text Mining In Excel?

Mar 12, 2014

Text mining in Excel? Is this possible? I'm think along the lines of sentiment analysis, part of speech tagging, that sort of thing. Are there add-ins for this, or libraries to hook into via VBA?

View 1 Replies View Related

Mining Text Fields

Mar 23, 2009

How would I group and count the occurences of specific words in a text field? This is my first step in trying to develop a scoring method based on our notes.

If the sentences above were in the text field, I'd expect the words "a" and "in" to come back with a count of two while all other words would come back with a count of 1.

View 9 Replies View Related

File Too Large To Open?

Mar 16, 2013

my colleague did something to one of our files and it is now 845918 kb. I transferred it to a flash drive and then to my hard drive but now I cant open it to see what is wrong. Is there a trick to opening this up? When it was opened on her computer it wouldn't let me add any tabs or move tabs. I think I unprotected it but that didn't change anything.

View 1 Replies View Related

Export Large File

Oct 30, 2002

I have a database of 75000 rows in text format which has to be converted to excel, but the limitation in excel is only 65536. hence, I want to a macro that will copy the 1st 65536 rows into the 1st sheet in excel. The remaining rows should be copied into the second sheet. I know that it can be done with access. but i dont want to use access.
I have got a code to do this, but it takes much too long. if the code could be modified to make it faster,


Sub LargeFileImport()

'Dimension Variables
Dim ResultStr As String
Dim FileName As String
Dim FileNum As Integer
Dim Counter As Double
'Ask User for File's Name
FileName = InputBox("Please enter the Text File's name, e.g.

View 9 Replies View Related

Opening Large File

Feb 4, 2009

I have a 14.3 MB xlsb file that I am trying to open with no success as it just hangs. Anyone have any ideas on how to get the data out of there? I would like to be able to get the data to a pivot and copy the pivot to another file to try and reduce the load on one file. I tried to import to Access but was told I was using a file version before 2007, which is impossible since it is a xlsb file.

View 9 Replies View Related

Excel File Too Large To Work

Feb 24, 2013

I've been having tremendous issues with my Excel file, mostly with it crashing or not responding. Would this be because my file has so much data in it? If so, is there anyway to make Excel process all the data without crashing so much?

View 6 Replies View Related

SUPER Large CSV File That I Cannot Open

Aug 1, 2008

I have a SUPER large CSV file that I cannot open in 2002 excel
Is there a way to write in VBA to import the csv but only include rows that contain "TESTIMPORT" in a cell?

View 9 Replies View Related

So Large File That Excel Cannot Open It...

May 4, 2009

I have a file that became too big due to phantom bloat, unused range saved by Excel and all that kind of reasons. Thank to previous posts on that board tackling that issue, I was able to find how to proceed to reduce the file back to its normal size.

But I did so in a beta file (test file). The real file has become so big (103MB!) that Excel cannot even open it anymore! The file contains archive info that we do not have anywhere else.

Is there anyway then to open the file or to reduce its size without opening it (through magics...)? I just honestly don't know how to retrieve that info before deleting that file.

View 9 Replies View Related

Import LARGE Text File

Aug 25, 2009

I have a large text file, 75mb, that I would like to import into Excel but it goes well beyond the 65536 lines available.

Is there a process to get these files into excel? File splitter?

View 9 Replies View Related

Large File - Stop From Lock Up

Jul 20, 2006

I have a file that is 40,000K...is there anyway to decrease this file size without having to delete data or break up the spreadsheet?

I couldn't think of anything but wanted to double check.

View 3 Replies View Related

Open Large Txt File With Query

Sep 20, 2006

I have a large text file (greater than 64k lines) which I need to import into excel. I only need anything imported from the text file that is for dates I specify. So I would like to run a line by line query and only import the lines I need.

The dates are always in position 43-50 (dd-mm-yy) in the text file itself, so the code would have to look at that section, see if the date is within the range specified and only import if it is (and then move onto the next line).

View 4 Replies View Related

Open Large Text File With Query?

Sep 20, 2006

I have a large text file (greater than 64k lines) which I need to import into excel. I only need anything imported from the text file that is for dates I specify. So I would like to run a line by line query and only import the lines I need.

The dates are always in position 43-50 (dd-mm-yy) in the text file itself, so the code would have to look at that section, see if the date is within the range specified and only import if it is (and then move onto the next line).

View 5 Replies View Related

Compressing Large Pivot Table File

Jun 7, 2013

My pivot table file is currently 12.7 MB and I need to get it much smaller so I can email it and it still be functional with the data.

I have tried right clicking on the pivot table, going to PivotTable Options, clicking on the data tab, unchecking the 'save source data with file' box, and checking the 'refresh data when opening file' box. This shrunk the file perfectly but when i email the file the Pivot Table was unusable because there was no data to back up the function.

The Error messages I got were 'Cannot open PivotTable source file'..... and 'Pivot Table report was saved without the underlying data. Use the Refresh Data command to update the report'. When I click on Refresh Data I still get the same error message.

Any way I can make this File smaller and still functional.

View 4 Replies View Related

Large Tab File Delete Filtered Rows

Apr 1, 2009

I have a large *.tab file with around 450,000 records. I opened the file in excel and then filtered two columns where there are values equal to 0.

I then highlight all the rows and try to delete them, but I receive the following error popup box:

"Microsoft Excel cannot create or use the data range reference because it is too complex."

How can I delete all these filtered = 0 rows without getting this error??

View 9 Replies View Related

Drop-down Boxes Make File Size Too Large

Aug 31, 2009

I'm using Excel 2007. I have a cell with a dropdown box that has the values 1 thru 10. When I save the file (as an Excel 97-2003 compatible .xls file), it's 17kb which is normal. I want multiple dropdown boxes going down the same column, so that every time the user goes to the next row, another dropdown box will be displayed. I copied the cell with the dropdown box, selected the entire column, and pasted the dropdown box.

This time when I save the document, it's over 2MB in file size. I've seen other spreadsheets with several columns of dropdown boxes spanning thousands of rows and they stay under 30kb. I don't know what they did differently to keep their file size small. Why is my file size so large and how do I fix this? Do I need to use a 'paste special' function?

View 3 Replies View Related

Large File Taking Much Time To Save Or Open?

Mar 29, 2014

i always receive 200 mb file. which i has, around 10 sheets , with pivot tables and formulas.

i have to open this file update refresh and save as this file, which i am doing via vba.

however the challenge for me here is though i set xl calculation to manual at the begining and xl calculation to automatic at the end. Though i used this code, its taking close to 5 mins to complete this via Vba.

how or what is the alternate way to reduce.

View 6 Replies View Related

Split Large File Into Multiple Smaller Files

Dec 12, 2009

On this forum, a script is provided to break a large Excel file into smaller 500-line files:

Split Worksheet Into Multiple Files By Every Nth Row

I copied the code and pasted it into the VBA editor in Excel 2007, but when I run the macro, it generates an error message:
Runtime error 91: Object variable or With block variable not set.

The line the debugger identifies as the one with the error is this one:
For lLoop = 1 To rLastCell.Row Step 500

Here is the full code from the previous thread: ...

View 9 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved