How Can I Merge Two CSV Files
Jan 2, 2009
I have two CSV's which are updated on a regular basis.
CSV Master - contains about 23,000 rows at the moment and will continue to grow.
CSV Master - does have a header row
CSV Master has unique (8 digit) numerical ID's in column A so all unique ID's start at "A2"
CSV Master - contains 31 columns ("A through to and including AE") this is a fixed figure.
---- Then I have ---
CSV Extras - generally contains about 200 rows and its unlikely it will ever be more but is contents are different every time it is used.
CSV Extras - does have a header row
CSV Extras has unique (8 digit) numerical ID's in column "A" so all unique ID's start at "A2" and these ID's are a common denominator with both sheets.
CSV Extras - contains 44 columns (last column is AR) which is a fixed figure,
CSV Extras - columns "B up to and including AE" are all intentionally all blank fields.
--- Hope that explains where I am, this is what I need to do ----
I need to be able to look up the ID's (that are in column A in both CSV's) and create a single CSV. In my mind that is a Vlookup of some sort but I can't get it to work
I want to open CSV Master and then, If the ID exists in CSV Extras then fetch all the data in columns "AF to AR" and add it to the CSV Master.
View 9 Replies
ADVERTISEMENT
Dec 6, 2006
1. I have a master file (master.xls), currently empty
2. I have 80 excels files (all look a like but their worksheet name are different)
3. I would like all the data from these worksheet to be appended to master.xls with a click of button.
4. I tried using some codes from this forum but they did not work.
5. All the source file starts with ums bla bla.xls
View 9 Replies
View Related
Jan 31, 2007
I have two files that need to be merged together (file1 & file2). These two files have three columns each. One column on both files is the same. This column is labled "phone number". One file has more lines the other has less.
I would like to make a macro that will check file1 against file2. If it finds a phone number the same it will cut the whole line and append staring in column 4 to same line in file1.
View 5 Replies
View Related
Dec 3, 2013
I have two separate excel worksheets from which i want to merge two columns from each worksheet into a new sheet. from the first sheet column A & E and from second worksheet column B & D. The values of second worksheets need to start where the value of first sheet ends. Want a macro to run this automatically every time.
Have tried to merge and consolidate but macro does not work.
View 3 Replies
View Related
Oct 7, 2008
Right now I need help mergng 2 files:
#1 One is a txt file with emails
#2 the other is a .csv excel file which contains several fields: email, name, address, etc
Basically what I need to do is to create another .csv excel file that contains all the emails in file#1 that are also present in the file #2 plus their corresponding additional fields ( name, address ) etc
View 9 Replies
View Related
Dec 21, 2009
I haven't really been able to find a total solution to an issue I have had for a while and hope someone can help.
I have a series of workbooks that I create from Crystal reports, I want to do the following after clicking a button on a form:-Open up two files in a folder with similar names (IL-BA, IL-BA-19), both have the same headers
Open a Third file, this is my 'Master File' and is in a different location, this has the same headers
Copy from the two files onto 1 sheet on my master file (excluding the headers)
Close the first two files without saving and move them to a 'Done' folder
Save and Close the Master File
Move onto the next set of files in the folder (NE - BA,NE - BA - 19) and do the same again, until all the files in the folder have been completed.
All the files in the folder have different data, so have different headers, but the Master file for each set will always have the same headers, (if that makes sense), but they are specifically named, so cycling through the named files in the folder, merging the two together.
My main problem is that I can't seem to find all the code i need, i can merge the two files, either in different sheets(which i don't want), or with the headers for each file still attached (as i can't seem to find a robust way of removing them).
View 9 Replies
View Related
Sep 30, 2011
I'm a long time excel user and I've come up with an issue, it can surely be solved in any other larger database language but excel is just my everyday friend and I was wondering if it's possible to do such a thing.
I have a list of "people" in my 1st ssheet and they have
ID | ProductName| Category | Year |
and I have this data on the 2nd ssheet
ID | Price | Description
There is 600.000 records in the primary sheet but only 22.000 in the secondary because the data doesn't repeat (one description can fit to 10.000 products, no need to write it down that much times).
But now I need to compile one big/large file, so I need to have one file that contains all:
ID | ProductName| Category | Year | + | Price | Description
In MS SQL I would use the "Where" function and compare the ID here and there, but is there a possible way to do it in excel?
View 6 Replies
View Related
Oct 12, 2007
I have hundreds and hundreds of excel files. but in every file, there is the same column lets say column D which has all the information I want. In stead of opening hundreds of worksheets and copying and pasting over the data into a new sheet. Is there a code I could write that would open all these files and copy the data from the same colum over into my new sheet? so column D in the first work book will copy to colulm A in the new work book. Then colum D in the second workboko will copy to the new worksheet in column B ect ect ect.
View 9 Replies
View Related
Oct 8, 2010
I have this macro to go to a specific folder and open up all of the files in the folder and merge them into a worksheet.
I want to change it so the user can select the files to be merged.
Sub MergeFiles()
Dim path As String, ThisWB As String, lngFilecounter As Long
Dim wbDest As Workbook, shtDest As Worksheet, ws As Worksheet
Dim Filename As String, Wkb As Workbook
Dim CopyRng As Range, Dest As Range
[Code]...
View 4 Replies
View Related
Feb 20, 2012
I have been opening files from another application which opens the files in memory as .XLS. I have not saved these to my PC. Is there VBA to merge all open .XLS files into another Workbook - preferably .XLSX.
View 1 Replies
View Related
Nov 28, 2006
I have two name/address lists in separate Excel workbooks. I need to merge and eliminate duplicates by name. One has single name field in format "Lastname, Firstname". The other has a single name field in "normal" format (First and last name). Ultimately I need to end up with two name fields, First and Last, and this I can do.
The problem is in identifying any possible duplicates between the two lists. Why? Because the first list will have names like "Smith, Robert" and occasionally maybe "Smith, Robert J.". The second list will have names like "Dr. Robert J. Smith Jr. PhD", as well as possibly "Robert Smith" or "Dr. Robert Smith".
Using Text-to-Columns will still require a lot of reworking, because the last name won't always be in the same column, depending on whether there's a Dr. or Mr. or middle initial and so forth.
I've looked into the LIKE( ) function which holds some scant hope, but I don't think it will happen for me either.
How I could compare "Robert Smith" to "Robert J. Smith" or "Dr. Robert Smith" or "Dr. Robert J. Smith Jr. Phd"? Imagine all names in column A.
View 9 Replies
View Related
Sep 9, 2006
is there any way for a worksheet to import and merge (append) tab delimited files from these directories:
C:TempmergeV¿ñdata.txt
C:TempmergeV¿ñ (2)data.txt
C:TempmergeV¿ñ (3)data.txt
C:TempmergeV¿ñ (4)data.txt
C:TempmergeV¿ñ (5)data.txt
- contents of data.txt have range A1:Pn, where 'n' is last row, different for each file
- found a previous thread very similar to what i wanted, but donno how to edit this to suit my purpose
[Solved] Importing: Import many TXT files to singe workshee
BTW, does VBA recognise directory folder with unicode characters? I can rename my directory if it doesn't.
View 3 Replies
View Related
Jun 6, 2008
I have a folder named DATAENTRY (consist 90-100 password protected files & it may increase whenever the need arises).
I need to merge A2 to (data in last available row & last available column) of each file in that folder into a single sheet named MERGEDDATA of file named MASTER.XLS.
I got one excellent code to unlock/lock the files automatically without opening the concerned files. This is the Link [url]
& the Code is: ...
View 5 Replies
View Related
Oct 12, 2010
merging the multiple *.xls files into one single *.xls file but each *.xls file com in separate worksheet.
Say i have 30 xls files in datewise i.e., 01.10.10, 02.10.10, 03.10.10 so on....
I want to merge all the above 30 xls files in single file master workbook - in that master workbook file the above 30 xls should come in separate work sheets.
View 9 Replies
View Related
Jan 6, 2009
I need to use to prepare for analysis a large set of individual participants' Excel data files collected using a psychological reaction-time experiment (a modified Stroop task). This experiment was created using a program called Superlab by Cedrus, so I posted an inquiry at the Superlab forum [url]. Their tech support suggested I might need to use macros in Excel but couldn't offer further assistance. I'll try to briefly describe (a) our Stroop task, (b) the operations I'm trying to carry out, and (c) the format of the individual Excel files,
Our Stroop task: The participant gets some instructions and practice trials, then a series of stimulus words are presented one word at a time in the center of a computer monitor in one of several colors. Word presentation order is randomized for each participant. The participant must press a key corresponding to the color of each word as quickly as possible. For each keypress (including the spacebar, pressed on instructions screens), the reaction time (in msec) is recorded in their Excel spreadsheet under the 'Reaction Time' variable. The 'Error Code' variable indicates whether the participant pressed the correct (C) or incorrect (E) color key in each trial. There are 8 types of words for a total of 48 trials. (Actually, 4 sets of emotion words and 4 sets of control-animal words, each set composed of 6 words each. The task basically measures how much peoples attention is captured by emotionally relevant cues in the environment.)
For each participant's data, I need an efficient way (macros?) to:
(1) clean it [i.e. discard or ignore the instruction & practice trials as well as trials where the participant was too impulsive (reaction time < 100 msec), too distracted (rt > 3000 msec), or gave the wrong color response (Error Code= E)]
(2) determine whether enough valid trials remain for further analysis (>39 trials), and if so:
(3) calculate a mean reaction time score for each of the 8 word types [where denominator for each word type is based on # remaining (non-discarded) trials for that word type]
(4) merge each participant's summarized data as single rows in a common spreadsheet (for importation and further analyses in SPSS), like this:
---------------------------
ID#...... MeanRTW1.......MeanRTW2...... (etc. for word types 3-8)
101.......1056................2013...............
102.......2148................2594...............
103...
---------------------------
Excel File Format: I've attached a sample file, and here's a simplified overview of a spreadsheet (irrelevant columns and some rows removed). First the ID number is recorded (e.g., 393E), then some unnecessary junk (exp name & date, intro, practice, instructions), then data for the 48 actual trials of interest:
-------------------------------------------
........A...............B..................C.................D............
1 393E
2 stroop.xpt
3 Wed Jan 1, 12:33:00 2008
4
5
6 Trial Name.....Trial No..... Error Code.....ReactionTime
7 introduction..... 1................C............561243
8 practice.......... 2................C............... 2062
9 red-worried........14.............C................1001 (*the first practice trial)
10 (9 more practice trial rows, deleted here)
19 instructions........3..............C................5000
20 red-chicken......19..............E............... 1205
21 blue-tense.......32...............C.................782
* (46 more actual trial rows, deleted here)
--------------------------------------------------
To clarify:
-The variable 'Trial Name' indicates nominally what stimulus was presented for each trial.
-The variable 'Trial No.', indicates the unique numerical marker for each stimulus word. (It probably should have been labeled 'Word Type'. It doesn't reflect the order of stimulus presentation. E.g., the word "tense" is always 'Trial No.' 32 for all participants, regardless of when it presents.)
-A subset of actual trial words (e.g., worried) were also used for the 10 practice trials. Thus, the 10 practice trials must first somehow be discarded or flagged to be ignored before calculating average reaction times for the remaining 48 actual trials.
View 14 Replies
View Related
Aug 20, 2006
I did a search for " import text" and found some promising leads, but not exactly what I was looking for. I have tried running macros and looking at the code but don't know how to pass the file names from the the D47:D147 range to VBA(see below). I saw elsewhere that Excel can be told to create a temporary batch file, and that the batch file with the command "copy text1.txt+text2.txt+text3.txt all.txt" for example could be used to merge the 3 text files into a file called all.txt. I don't however know how specify the path where copy starts, to tell the batch file to look in subdirectories or to pass the file into Excel. I've posted this question yesterday to Yahoo Answers http://tinyurl.com/omers and http://tinyurl.com/rfww9 without much luck.
Below is the macro I would like:I have text files whose names are found in the range D47:D147 although without the appended ".txt" extension. The sheets can only contain one name sometimes, but on average 8 to 10, so in the average case only cells D47:D56 would have entries.The text files are found in the say H:Textfiles directory or subdirectories.I would like Excel to find these files, concatenate them with a row between each file, and paste the results into cell K251.Finally, the text import wizard should be used with a space as a delimiter and the last 3 columns (it's sometimes only 2) of the concatenated file, not imported.
View 2 Replies
View Related
Feb 6, 2009
Often I need to add data from one spreadsheet to the appropriate places on another spreadsheet. For example:
Sheet A has 10,000 records with these fields: id#, name, address, place of employment.
Sheet B has 5,000 records these fields: id#, GPA, college major, type of degree.
Some of the records in B contain information for the same id#'s as sheet A. I want to add this information together so that a Sheet C will have these fields: id#, name, address, place of employment, GPA, college major, type of degree.
View 3 Replies
View Related
May 14, 2013
Trying to write a script to carry out a number of tasks but is there code to enable an Excel to look in a particular file for the list of csv files - carry out the tasks and return the appropriate values in the Excel sheet whilst leaving the original csv files untouched?
View 2 Replies
View Related
Jun 26, 2009
Need a way to update a single master file. What happens right now is that the cost manager sends out one file to a lot of different project heads and then on having them return back to him he basically has to individually add in all the data. What i am trying to do is that he somehow carries on sending out the data as there are a lottt of projects and then on returning them they automatically update.
View 14 Replies
View Related
Jan 4, 2014
how I can loop through folders to select files starting with a certain word and copy all of them to a different folder and rename them. The folder structure is given below
Company 1(parent folder)
North South East(sub folder) West(sub folder)
Jan Feb Mar.... Dec Jan Feb Mar.... Dec Jan Feb Mar.... Dec Jan Feb Mar.... Dec
In the above structure, the files are present inside each folders Jan, feb...Dec under the regions North, South East n west. note that I have to select files starting with "Sales" and copy them into a new folder(say results) and rename copied files as Sales1.xls, Sales2.xls etc. (Files are not present in the folder company1, north, south, east and east.)
View 1 Replies
View Related
Jul 5, 2007
I want to allow users to place files (.jpg, .tif, .pdf, .pps etc) into a network folder and then have my program open each file and display it for 30 seconds then close the file and the application before opening the next file.
1. Set up a loop to get a directory listing of the folder and write the listing to a text file.
2. Open up the text file and get the next filename in it
3. Open the file in the associated application
4. Wait for 30 seconds (or some period of time) and then close the file
5. Repeat steps 2-4
DoIt = 1
While DoIt = 1
Open "C:TempList.txt" for output as #1
Print #1, Files In Folder
Close #1
Open "C:TempList.txt" for input as #2
while not eof(2)
Line input #2, MyFile
Display MyFile on screen
Wait for 30 seconds
Close MyFile and MyApplication that opened it
wend
Close #2
I can get the directory listing just fine with no problems
I can open the files in the associated application just fine with no problems.
with closing the application after 30 seconds or some period of time.
I need some code that will allow me to easily send it a filename and it will know how to close the file and the application that opened it.
View 9 Replies
View Related
Feb 8, 2009
I have an Excel application (Excel 2003) which is stored in the default Program Files folder by the Installer; for example: c:program fileszxchello.xls. The problem I am running into is this file opens as Read Only in Vista and this is interfering with the running of the application. There is no problem opening the file normally in Windows XP.
I have been able to narrow down the cause of this to the User Account Control system in Vista - if I turn OFF User Account Control, the Excel file opens normally and my application functions normally. Is there another option to open the Excel file without turning OFF User Account Control because some users may find it unacceptable to turn OFF this security feature. Ofcourse, one option is to install the application in another location, outside the Program Folder, and the file would open normally, but the Packaging Wizard that I am using to package the application does not allow me to install the application in any other location and thus, the application installs in the Program Folder and I am running into this problem of the Exel file opening as Read Only. Is there a way out of this situation where I can open the file normally (not as Read Only)?
View 5 Replies
View Related
Jul 13, 2006
I'm using the following code to import thousands of html files into my spreadsheet. The code is working fine. Since I am importing thousands of files, when there is no more space on my worksheet, the code stops with an error message. I want to make this code add another worksheet & continue importing the html files until there are no more files to import.
Sub Master_Importer()
Dim I As Long
Dim strFilename As String
Dim strPath As String
strPath = "file:///C:/Documents and Settings/c/Desktop/New Folder/"
With Application.FileSearch
.LookIn = "C:Documents and SettingscDesktopNew Folder"
.FileType = msoFileTypeAllFiles
.Execute
For I = 1 To .FoundFiles.Count
strFilename = Mid(.FoundFiles(I), InStrRev(.FoundFiles(I), "") + 1)
With ActiveSheet.QueryTables.Add(Connection:= _
"URL;" & strPath & strFilename _ .......................
View 5 Replies
View Related
Dec 21, 2007
I have a excel file that I enter information into. I have code that saves the files to a certain folder with the name, date, and time stamp for the file name. At the end of the day I might have 3 to 15 excel files I have created that day and I would like to take information from certain cells (examle: L3, B6, B7, B8, G8, and so on) and create a txt file with all of the information in it.
Example:
12/20/2007
Your Name
123 Somewhere St.
Here, OH 45111
Home Visit
12/20/2007
Someone Else
345 Anywhere St.
There, OH 45211
Hospital Visit
View 9 Replies
View Related
Apr 8, 2014
I is it possible to convert all comma separated text files in a single folder in to excel files. But the requirement is to have 2 sheets in each new file. first to be the full file - with all columns, and in the second sheet to keep only colum A B D G H K L M O P R S T V W from the first sheet. The second sheet name must be the same as the first one but without the first "wlist_" in the name.
One more thing. The third column in the second is called "COUL". there are short letters for colors in french
can they be converted with the sort in English like it goes:
NO = B
BA = W
RG = R
SO = P
JA = Y
BE = L
VE = GY
GR = G
VI = V
MA = BR
BJ = TA
OR = O
Here is a link to the both CSV and an example excel file with the end result. In this example i haven`t change the shorts for the colors. It takes me too much time with the find and replace function. And at the moment i`m really pushed from time.
[URL]
View 9 Replies
View Related
Apr 2, 2014
I have 50 files each with 1000 numbers in column A.
I need to compare every list with every other list and calculate the Pearson function.
I am ok with the vb code to compare every file with everyother.
I can do this by opening each file then closing but it takes too long.
Each of the 50 csv file names is in my destination workbook
I would like to define an array using the file name, then extract 2 lists without opening the files then perform the pearson function and place the value in the destination workbook. (The pearson function just measures the strength of correlation between 2 sets of numbers)
View 4 Replies
View Related
Sep 15, 2009
I have a large number of .txt files that are comma separated files (but not saved with the .csv extension) that I need to convert to files with the .csv extension.
Is there an easy way to do this for all files in a given folder? Ideally, the files don't even need to be opened as they are are quite large in size (70MB+) and there are a lot of them (500+).
View 9 Replies
View Related
Sep 26, 2007
I have about 100 Excel files in one folder that need to be saved as text files. They can keep the same name, but simply need to be converted to text files. I'd like to use VBA for this and I can't find examples that do exactly that...or ones that my limited knowledge can handle.
Excel files exist in C:Source and ALL of them should be saved as text files in C:Destination. Maybe there is an easier way, but I thought for sure there was a routine I could use.
View 4 Replies
View Related
Jan 23, 2008
I have 22 CSV files. I want to search each of those files for a specific text string (ie: "profile" or "description"). When the macro finds the word in any one of the CSV files I want it to copy that complete csv worksheet and paste it into an excel xls file.
how I can go about doing this. Not also that while vlookup is possible, its very time consuming if i have to do this 50 times over and each time the csv files have different file names. that is why i want to search within a file (each file has its own unique identifying text string)
View 2 Replies
View Related
Apr 21, 2009
I have the code below. It openes all csv files within a folder, then delete rows depending on the value of a cell. Now it needs to save the file as a xls file ....
View 9 Replies
View Related
