Splitting A Large File Into Two And Mining The Data
Apr 17, 2008
I've been scouring the Internet for a few days now trying to get a macro working with varying degrees of success. It's driving me mad and I'm really hoping that someone out there can help me out. I'm trying to write a macro that will ...
1. Take a .xls file
2. Split the file in two
3. Take cells B2:B11 and paste them in to a csv file (to be called Upload1.csv) using the rows as column headers (i.e. B2:B11 now become A1:J1)
4. Take cells A13-J13 downwards (this file will have different numbers of rows each time it's generated) and paste them into a different csv file (to be called Upload2.csv) populating all the rows (except all rows in column I which are to be left blank) and all rows in Column J which are to contain the info in cell B7 of the original document.
5. In cell B11 of the original document I must only take the information that says MyAddress:xxxxx and discard all the other info
6. I must also loop through the second document until I find the words Total and copy everything UNTIL that row into the new document.
I know this probably sounds pretty awkward but in practice it's not that difficult to understand, it's probably the way that I've explained it
So far I've managed to take the original document and split it, populate both CSV files but I'm having problems with looping the macro until it sees the word Total and discards it and also populating the appropriate rows with the info from B7 ... I don't know how to make it populate only the rows that have info on them.
I've attached the original Excel file that is generated and also my attempt at the 2 csv files. I've also written in RED what needs to go where in each document.
View 14 Replies
ADVERTISEMENT
Jul 19, 2014
I have a text file with rows and columns of numbers ranging from 1-4 digits that I'd like to import/copy into Excel with each number being in its own cell. But whenever I copy/try to import, Excel splits all of the 3-4 digit numbers up into single digit numbers. The text file has 10,000+ columns (each number occupies two columns so I have half of that amount in numbers) and 300+ lines.
Is the file simply too large for Excel to handle or is there a way I can do this?
View 14 Replies
View Related
Jun 5, 2008
I've got an Excel document that is generated from a third party programme (See ExcelDoc attached) ....
View 9 Replies
View Related
Nov 16, 2009
I have a spreadsheet with a column of Longitude values like:
A
172828.383E
I want to somehow split the cell into new individual cells so it will be like this:
A B C
17 28 28.383
View 5 Replies
View Related
Dec 11, 2008
I have an excel spreadsheet that has the following type of data in the cells:
"11/09/08 20:29 JDS David/DBLD reports lights in the canopy are not working Christine/CBRE b4957204-1"
I need to know if there is a way to mine the B4957204-1 out of this, I have 300 cells with similiar text in that I need just a list of call #'s out of without all the other dribble.
View 14 Replies
View Related
Apr 26, 2013
I have 2 large XLS sheets that need to be split into seperate sheets.
The first is only 5 columns wide but the amount of rows changes day to day.
The second is a maximum of 7 columns wide and again the amount of rows will change.
I'm hoping for a VBA code to be able to do both on seperate books.
The A Column has the name of the company, and this can include (/,&) that will need to be removed, the names can also exceed 31 characters.
I would like to seperate the sheets by the company name and have the name appear as the sheet name.
Also the formatting from the master sheet to be copied to the resulting sheets, with a header row.
I have included the data for the larger of the two workbooks. data.jpg I have to pull the smaller report each day and the larger report each week.
View 3 Replies
View Related
Nov 15, 2011
There are websites available for data, but what is viable and crucial to me is finding a way to
1) Run a repeated process via a macro / vba script to allow for data input into the site
2) Once input into site, data is to be brought back into excel so that I can benchmark my product pricing vs my competition
There are 2 sites I am most interested in getting this information from specifically and although they do the same thing they have a couple of unique pros to them. they are the following
1) Findchips.com
2) eciaauthorized.com
The biggest pro to findchips.com is that they have a beta tool on their site that allows for "mass searches" to be performed as opposed to 1 part number at a time. Up to 100 results can be returned at a time, so although there would be multiple iterations doing it this way would save processing power as each step is not done line by line (p/n by p/n) as i could group them and send them and perform the operations that way.
View 9 Replies
View Related
Jan 10, 2008
Engineering has given me 300 separate 2003 Excel Files. Each of these individual Excel files contains data I need for creating a list I have been tasked to do. Cells E3, K1, A6 and J2 in each Excel file contain the data I need for my list. Rather than manually data mining 300 separate Excel files for data I need from Cells E3, K1, A6 and J2, can this be done automatically with a macro?
I'm seeking for the Macro to automatically OPEN each individual Excel file, then copy the data from Cells E3, K1, A6, J2, and then paste this data into a list file with four columns. After the pasting is done, the macro will close the source data Excel file and move on to the next one. In the future I will have to repeat this task with probably 400 individual Excel files. Therefore, it will be great if the Macro didn't care how many Excel files required data mining.
View 4 Replies
View Related
Jan 21, 2010
I want to use the attached Test.xls file below and do a lookup from the Data.csv (see zip file) where "Empl ID" (column A in Test.xls) matches "ID" (column A in Data.csv). I want to bring back "SupvID" (column B in Data.csv) into column D in Test.xls.
The problem I have is that in real life Data.csv is a very large file and contains more than Excel's maximum number of rows. I want to automate this using VBA to lookup the values without opening the csv file.
I have looked at a number of forums for answers and I can see where using an ADO connection will probably help accomplish this, but I can't seem to get it to work on these specific files.
View 4 Replies
View Related
Jan 9, 2008
I have some spreadsheets one worksheet little data and it saved as it a 5MB file when it should only save as something like 500Kb, what would cause this?
View 3 Replies
View Related
Aug 6, 2003
I've got a 80 Mb CSV file and would like to open and work with it. Too many lines (90000 or so).
Is there a way to split ( ) this file so I can open two files instead?
View 9 Replies
View Related
Mar 3, 2014
I am trying to use excel tools to clean dirty data and compare the two cells. The information is there but tainted with additional information that is not relevant. I have tried to use Left/Right tools to capture alpha characters leading an address number with no real success. Also, when I get the data it seems to have some embedded breaks that I can't seem to get rid of that cause my tasks to error too.
View 4 Replies
View Related
Nov 24, 2008
I am trying to split up an excel file that has 18000 lines, i want to break this into groups of 100 lines and retain the original header info on line one for each file. Is this possible to do with a macro. I have NO experience with macros of programming so go easy on me. It would be great if it could autosave as book 1 book 2 book 3 or whatever, file name doesn't matter that much.
View 9 Replies
View Related
Mar 12, 2014
Text mining in Excel? Is this possible? I'm think along the lines of sentiment analysis, part of speech tagging, that sort of thing. Are there add-ins for this, or libraries to hook into via VBA?
View 1 Replies
View Related
Mar 23, 2009
How would I group and count the occurences of specific words in a text field? This is my first step in trying to develop a scoring method based on our notes.
If the sentences above were in the text field, I'd expect the words "a" and "in" to come back with a count of two while all other words would come back with a count of 1.
View 9 Replies
View Related
Mar 16, 2013
my colleague did something to one of our files and it is now 845918 kb. I transferred it to a flash drive and then to my hard drive but now I cant open it to see what is wrong. Is there a trick to opening this up? When it was opened on her computer it wouldn't let me add any tabs or move tabs. I think I unprotected it but that didn't change anything.
View 1 Replies
View Related
Oct 30, 2002
I have a database of 75000 rows in text format which has to be converted to excel, but the limitation in excel is only 65536. hence, I want to a macro that will copy the 1st 65536 rows into the 1st sheet in excel. The remaining rows should be copied into the second sheet. I know that it can be done with access. but i dont want to use access.
I have got a code to do this, but it takes much too long. if the code could be modified to make it faster,
Sub LargeFileImport()
'Dimension Variables
Dim ResultStr As String
Dim FileName As String
Dim FileNum As Integer
Dim Counter As Double
'Ask User for File's Name
FileName = InputBox("Please enter the Text File's name, e.g.
View 9 Replies
View Related
Feb 4, 2009
I have a 14.3 MB xlsb file that I am trying to open with no success as it just hangs. Anyone have any ideas on how to get the data out of there? I would like to be able to get the data to a pivot and copy the pivot to another file to try and reduce the load on one file. I tried to import to Access but was told I was using a file version before 2007, which is impossible since it is a xlsb file.
View 9 Replies
View Related
Feb 24, 2013
I've been having tremendous issues with my Excel file, mostly with it crashing or not responding. Would this be because my file has so much data in it? If so, is there anyway to make Excel process all the data without crashing so much?
View 6 Replies
View Related
Aug 1, 2008
I have a SUPER large CSV file that I cannot open in 2002 excel
Is there a way to write in VBA to import the csv but only include rows that contain "TESTIMPORT" in a cell?
View 9 Replies
View Related
May 4, 2009
I have a file that became too big due to phantom bloat, unused range saved by Excel and all that kind of reasons. Thank to previous posts on that board tackling that issue, I was able to find how to proceed to reduce the file back to its normal size.
But I did so in a beta file (test file). The real file has become so big (103MB!) that Excel cannot even open it anymore! The file contains archive info that we do not have anywhere else.
Is there anyway then to open the file or to reduce its size without opening it (through magics...)? I just honestly don't know how to retrieve that info before deleting that file.
View 9 Replies
View Related
Aug 25, 2009
I have a large text file, 75mb, that I would like to import into Excel but it goes well beyond the 65536 lines available.
Is there a process to get these files into excel? File splitter?
View 9 Replies
View Related
Jul 20, 2006
I have a file that is 40,000K...is there anyway to decrease this file size without having to delete data or break up the spreadsheet?
I couldn't think of anything but wanted to double check.
View 3 Replies
View Related
Sep 20, 2006
I have a large text file (greater than 64k lines) which I need to import into excel. I only need anything imported from the text file that is for dates I specify. So I would like to run a line by line query and only import the lines I need.
The dates are always in position 43-50 (dd-mm-yy) in the text file itself, so the code would have to look at that section, see if the date is within the range specified and only import if it is (and then move onto the next line).
View 4 Replies
View Related
Sep 20, 2006
I have a large text file (greater than 64k lines) which I need to import into excel. I only need anything imported from the text file that is for dates I specify. So I would like to run a line by line query and only import the lines I need.
The dates are always in position 43-50 (dd-mm-yy) in the text file itself, so the code would have to look at that section, see if the date is within the range specified and only import if it is (and then move onto the next line).
View 5 Replies
View Related
Jun 7, 2013
My pivot table file is currently 12.7 MB and I need to get it much smaller so I can email it and it still be functional with the data.
I have tried right clicking on the pivot table, going to PivotTable Options, clicking on the data tab, unchecking the 'save source data with file' box, and checking the 'refresh data when opening file' box. This shrunk the file perfectly but when i email the file the Pivot Table was unusable because there was no data to back up the function.
The Error messages I got were 'Cannot open PivotTable source file'..... and 'Pivot Table report was saved without the underlying data. Use the Refresh Data command to update the report'. When I click on Refresh Data I still get the same error message.
Any way I can make this File smaller and still functional.
View 4 Replies
View Related
Apr 1, 2009
I have a large *.tab file with around 450,000 records. I opened the file in excel and then filtered two columns where there are values equal to 0.
I then highlight all the rows and try to delete them, but I receive the following error popup box:
"Microsoft Excel cannot create or use the data range reference because it is too complex."
How can I delete all these filtered = 0 rows without getting this error??
View 9 Replies
View Related
Aug 31, 2009
I'm using Excel 2007. I have a cell with a dropdown box that has the values 1 thru 10. When I save the file (as an Excel 97-2003 compatible .xls file), it's 17kb which is normal. I want multiple dropdown boxes going down the same column, so that every time the user goes to the next row, another dropdown box will be displayed. I copied the cell with the dropdown box, selected the entire column, and pasted the dropdown box.
This time when I save the document, it's over 2MB in file size. I've seen other spreadsheets with several columns of dropdown boxes spanning thousands of rows and they stay under 30kb. I don't know what they did differently to keep their file size small. Why is my file size so large and how do I fix this? Do I need to use a 'paste special' function?
View 3 Replies
View Related
Mar 29, 2014
i always receive 200 mb file. which i has, around 10 sheets , with pivot tables and formulas.
i have to open this file update refresh and save as this file, which i am doing via vba.
however the challenge for me here is though i set xl calculation to manual at the begining and xl calculation to automatic at the end. Though i used this code, its taking close to 5 mins to complete this via Vba.
how or what is the alternate way to reduce.
View 6 Replies
View Related
Dec 12, 2009
On this forum, a script is provided to break a large Excel file into smaller 500-line files:
Split Worksheet Into Multiple Files By Every Nth Row
I copied the code and pasted it into the VBA editor in Excel 2007, but when I run the macro, it generates an error message:
Runtime error 91: Object variable or With block variable not set.
The line the debugger identifies as the one with the error is this one:
For lLoop = 1 To rLastCell.Row Step 500
Here is the full code from the previous thread: ...
View 9 Replies
View Related