Data Mining / Extraction From Web
Nov 15, 2011
There are websites available for data, but what is viable and crucial to me is finding a way to
1) Run a repeated process via a macro / vba script to allow for data input into the site
2) Once input into site, data is to be brought back into excel so that I can benchmark my product pricing vs my competition
There are 2 sites I am most interested in getting this information from specifically and although they do the same thing they have a couple of unique pros to them. they are the following
1) Findchips.com
2) eciaauthorized.com
The biggest pro to findchips.com is that they have a beta tool on their site that allows for "mass searches" to be performed as opposed to 1 part number at a time. Up to 100 results can be returned at a time, so although there would be multiple iterations doing it this way would save processing power as each step is not done line by line (p/n by p/n) as i could group them and send them and perform the operations that way.
View 9 Replies
ADVERTISEMENT
Dec 11, 2008
I have an excel spreadsheet that has the following type of data in the cells:
"11/09/08 20:29 JDS David/DBLD reports lights in the canopy are not working Christine/CBRE b4957204-1"
I need to know if there is a way to mine the B4957204-1 out of this, I have 300 cells with similiar text in that I need just a list of call #'s out of without all the other dribble.
View 14 Replies
View Related
Jan 10, 2008
Engineering has given me 300 separate 2003 Excel Files. Each of these individual Excel files contains data I need for creating a list I have been tasked to do. Cells E3, K1, A6 and J2 in each Excel file contain the data I need for my list. Rather than manually data mining 300 separate Excel files for data I need from Cells E3, K1, A6 and J2, can this be done automatically with a macro?
I'm seeking for the Macro to automatically OPEN each individual Excel file, then copy the data from Cells E3, K1, A6, J2, and then paste this data into a list file with four columns. After the pasting is done, the macro will close the source data Excel file and move on to the next one. In the future I will have to repeat this task with probably 400 individual Excel files. Therefore, it will be great if the Macro didn't care how many Excel files required data mining.
View 4 Replies
View Related
Apr 17, 2008
I've been scouring the Internet for a few days now trying to get a macro working with varying degrees of success. It's driving me mad and I'm really hoping that someone out there can help me out. I'm trying to write a macro that will ...
1. Take a .xls file
2. Split the file in two
3. Take cells B2:B11 and paste them in to a csv file (to be called Upload1.csv) using the rows as column headers (i.e. B2:B11 now become A1:J1)
4. Take cells A13-J13 downwards (this file will have different numbers of rows each time it's generated) and paste them into a different csv file (to be called Upload2.csv) populating all the rows (except all rows in column I which are to be left blank) and all rows in Column J which are to contain the info in cell B7 of the original document.
5. In cell B11 of the original document I must only take the information that says MyAddress:xxxxx and discard all the other info
6. I must also loop through the second document until I find the words Total and copy everything UNTIL that row into the new document.
I know this probably sounds pretty awkward but in practice it's not that difficult to understand, it's probably the way that I've explained it
So far I've managed to take the original document and split it, populate both CSV files but I'm having problems with looping the macro until it sees the word Total and discards it and also populating the appropriate rows with the info from B7 ... I don't know how to make it populate only the rows that have info on them.
I've attached the original Excel file that is generated and also my attempt at the 2 csv files. I've also written in RED what needs to go where in each document.
View 14 Replies
View Related
Mar 11, 2008
I have an excel file with a large list of data in the following format, all the data is in the A column –
Mar 11: category one – process number one (1)
Mar 11: category two – process number two (2)
Mar 11: category three – process number three (3)
Mar 11: category four – process number four (4)
Mar 11: category five – process number five (5)
I would like to extract from the list, ONLY the data highlighted in red i.e. the process number data –
Mar 11: category one – process number one (1)
Mar 11: category two – process number two (2)
Mar 11: category three – process number three (3)
Mar 11: category four – process number four (4)
Mar 11: category five – process number five (5)
View 9 Replies
View Related
Oct 23, 2008
I have a folder on my drive that holds excel files, some of which I would like to extract data from, using an excel workbook outside the folder.
Can you assist me in achieiving this action? Or, direct me to literature that will have the answer?
View 6 Replies
View Related
Feb 18, 2014
I have a table similar to this
L M N O P Q
title1 title2 title3 0
12 5 0
0 23 0
13 1 0
453 1 0
I need a formula to get the following structure (without using macro):
A B C
title1 title2 title3
12 5 0
0 23 0
13 1 0
453 1 0
Attached File : ReturnNonblanks.xlsx‎
View 6 Replies
View Related
Feb 4, 2010
I just wanted to ask whether the same code will work for many more sheets or will modification be needed? I have a very basic understanding of vba loops, so plz tell me did you check the entire row for being blank or specific cells? Im attaching a file which more closely resembles the data i work with, just tell me whether the previous macro called "ravi" will work fine or will it require modification.
View 12 Replies
View Related
Dec 14, 2011
From the website [URL] ....
I need the Name, Website and contact details. I tried to extract but there is no ID for the element.
Data from the above site is:
1 Name: Shopping da Midia
2. Website: It is a hyperlink of Shopping da Midia that is [URL] ......
3. Contact details:
Tel: 16 2101-2500
Av. Independencia , 192
CEP: 14010-210
Ribeireo Preto
E-mail: compras@cdvirgem.com.br
View 5 Replies
View Related
May 19, 2014
This table has one column with people's names, other columns with different things, and one with hours.
The figures will change every month, and my dad doesn't know crap about excel, so anything that he has to go put in equations or sort again every month or whatever, is not going to work. it needs to be so that all he has to do is plug in numbers.
It can be either one or two ways: either I need to pull out all the rows that have hours above a certain amount, and have them sitting to the side/under/above the main table in the same worksheet.
I realize that that may involve a long complicated formula, however.
Alternatively, we can have it so that all the rows with hours above a certain number are color coded at located at the top of the main table. I figured that one out with ease, HOWEVER I don't how to make that automatic, so that it does it by itself when the numbers are plugged in each month. My dad would not be able to handle sorting.
I need the hours that =0 color coded and put at the bottom if possible, it's not absolutely necessary, however. I could not figure out how to put the highest hours on top and the hours equaling 0 at the bottom, considering that all rowsthat fall in between need to be kept in alphabetical order.
View 9 Replies
View Related
Feb 23, 2010
I want to pull data from another sheet, however there are multiple listings of each and I want to pull the data to another sheet for each line. I maybe easier if I try and show below:
Col. ACol. BCol. C
Smith101
Jones512
Green65
Black1214
Smith 3612
Jones1512
Dual25
Green1225
I want to pull this data for each name in Col. A in to another sheet. I've tried "IF", "Vlookup" and a couple of others, it just seems to be hitting the first option and pulling the data but not the ones below.
So if I selected Green on the second tab it brings through the "6" and "5", but not informtion from the listing from Green below. So I wiould like to list all the Green's, and the applicable data.
View 4 Replies
View Related
Nov 13, 2009
I'm doing some simple data extraction, e.g.
A B
1 bob 3
2 mandy 4
3 charlie 6
4 dave 1
5 steve 5
So I had in c1 to c5 = =if(b1 > 3, a1,"") autofilled, which works fine, but I end up with,
gap
mandy
charlie
gap
steve
how would I get,
mandy
charlie
steve
also is it possible to have an if statement in 1 cell change the value of another cell?
e.g.
in a1
if(b1>5, c1="yes",c1="no"), can't seem to get it to work
View 14 Replies
View Related
Jul 3, 2013
I have 3 set of data representing 3 countries of data in 3 different spreadsheet.
I want to create a summary page and using a drop down list, when county is selected, corresponding data are extracted and fall into the template.
how can i do this ?
View 14 Replies
View Related
Jan 22, 2014
To start off macro should pick selected columns such as owners and their projects, start date, price Final price, priority and status columns and paste into new sheet
At the same time only pick selected owners(Dave, Brian, Ken, Russell, Ben)data along with their high low, and medium projects then format the price and the final price column (that is to first convert them to numbers, then change it to the currency format and set the decimal place to 0) and then sort owners (AtoZ) along with Price and final price columns (largest to smallest) into a new workbook and to a new sheet in the same workbook with a name to the sheet called Extracted data
note owners may change and new members might get included in the list ( I am not sure if something dynamically can be done about this in the macro)
I have included sample data and how the output should look like.
View 14 Replies
View Related
Jul 14, 2008
I'm trying to determine a way to populate a listbox with the contents of a few cells full of vblf-delimited information.
It's almost working properly, but placing the first entry in the target cells last in the listbox and have no idea why it's behaving this way.
View 9 Replies
View Related
Mar 4, 2009
I have several large excel spreadsheets with thousands of entries (autocad drawing numbers). In one column it lists the date the drawing was created. Unfortunatley most of the entries were input as text. Even though I have formated the column to a date format (01/01/2009) most entries are not converting. Below is an example of some of the cells:
Jan. 12/02
JAN12/02
How can I correct his?
View 5 Replies
View Related
Nov 30, 2012
Creating a drop down menu that allows me to pull data from sheet2.
I have all of my data on sheet2 and my objective is to have a small portion of the data displayed on sheet1 once the user selects the specific "study" from a drop down menu.
how to create a drop down menu that will have a list of all the different studies, and then once the specific study is selected, how do I make it display the pertaining information in the master sheet.
Follow up....more information
The data I’m working with is a master list of different drug studies. All of the data is broken down by the specific study itself, so all I need to do is figure out a way to let the user access the data in a quick and easy way. I figured this could be down with a drop down menu that has a list of each study, and the user could select the study they want to review. Once selected, the data pertaining to the study would then populate the fields on the master silde(sheet1).
View 9 Replies
View Related
Apr 24, 2013
I have daily production sheets (Excel sheets) that I fill out every day indicating the day's production totals. The files are named by the day's date. For example today's sheet (4/24/13) would be 042413.xls. However, I would like to be able to pull certain pieces of information into another separate spreadsheet. For example, my boss asked me how many of a certain product we made over the last month. So, I'd like to pull the product info, the date made, and quantity made into another sheet. And I'd like to be able to do this automatically for a date range that I specify.
View 8 Replies
View Related
Feb 5, 2014
I created a macro for data segregation and extraction.
My currently flow is:create new worksheets rename the worksheets to e.g., sheet1 to product1, sheet2 to product2, etc manually filter the main data sheet, copy and paste the data into the respective sheets.
How to i edit the codes to allow the renaming of the worksheets to be non-static?
Meaning it doesn't have to be sheet1 to product1, sheet2 to product2
I can have sheet3 to product1, sheet4 to product2 or sheet7 to product1, sheet8 to product2
I feel that my method of data segregation and extraction is kind of rigid. is there any methods i can make it to be more fluid/dynamic?
View 1 Replies
View Related
Sep 8, 2009
I've attached a spreadsheet that I'm working on. I want to be able to extract data from a master sheet and copy data to another sheet if the date is within a defined date-range. I've prototyped the problem within the attachment.
Given the code in macro2, none of the records are selected (the "yep"). What am I doing wrong?
View 2 Replies
View Related
Jan 20, 2010
Example attachment is included. The goal of this is to extract data off of another sheet based upon an input value. It's easy enough to where the input value will be equivalent to the sheet name I want to reference. The example I provide incorporates code that works successfully. The only problems I have are:
1. The select method only works on the active sheet. I want to be able to call this while another sheet is active.
2. My code is very inefficient and takes a while to execute. I'd like to cut down on the execution time.
View 2 Replies
View Related
Apr 11, 2013
Data in cell A1 - 1) A Q
Data in cell A2 - 12) V
Data in cell A3 - 131) B H L
How do I throw away the #) and the following space in cells A1, A2, and A3 and save the rest?
Excel 2003. ie. no VBA.
View 4 Replies
View Related
Mar 12, 2014
Text mining in Excel? Is this possible? I'm think along the lines of sentiment analysis, part of speech tagging, that sort of thing. Are there add-ins for this, or libraries to hook into via VBA?
View 1 Replies
View Related
Mar 23, 2009
How would I group and count the occurences of specific words in a text field? This is my first step in trying to develop a scoring method based on our notes.
If the sentences above were in the text field, I'd expect the words "a" and "in" to come back with a count of two while all other words would come back with a count of 1.
View 9 Replies
View Related
Mar 20, 2009
I have directory with multiple workbooks. Each workbook contains multiple sheets (sheet 1, sheet 2, etc). On each sheet of the workbook, there are various data. The data I am looking to extract from these sheets are in the same cell of each sheet. (See data sheet –datasheet.xls). If I can extract these data without opening the file, it would be preferred. Otherwise, opening the workbook, extract the data, and then close the workbook is acceptable.
Desired Solution:
I would like the assistance to create a macro that will extract data from each sheet of the workbook in the directory at a time until all the workbooks and sheets within the directory are read. The macro shall extract data from cell B5, B6, B10:B20, and sheet name from each sheet of the workbook and copy these data to an active sheet called “US” on workbook, DesireResult.xls. The DesireResult.xls shows how the data should be copied over. Before copying the data to the DesireResult.xls workbook, the macro will prompt the user to enter a cell on the “US” sheet as the starting point to paste the information to. Prompting the user to enter the beginning cell shall happen only once and not for each workbook or sheet being read. The reason for this is because the “US” sheet will already have other data in it. After reading each sheet, the macro shall leave a blank row at the end. The data from the next sheet shall be pasted below the blank row. Note: all the workbooks contain macro and link to other file. When opening each workbook, the macro should automatically choose not to update the links.
View 4 Replies
View Related
May 14, 2013
SIZE-help.xlsx
I need to show the sizes to shows from column A to show in column b.
View 4 Replies
View Related
Jul 6, 2009
can anybody tell me how the get the name of a sheet as a string?
i have a formula using the name of a sheet and i dont want to leave it hardcoded.
ex:
=IF(ISERROR(MATCH(_02.07.2009!B6;(OFFSET(_01.07.2009!$B$5;0;0;COUNTA(_01.07.2009!$B:$B)-1;1));0));1;0)
i need that dates as variables. those are the names of the sheets im using.
View 10 Replies
View Related
Mar 24, 2009
In cell A1 I have the text
20. Black Angel Blues (Sweet Black Angel) - Nighthawk, Robert
In cell B2 I would like all of the text from the period/full stop after '20' until the - hyphen character
In cell C2 I would like the text after the hypen, but if as in this case there is a surname followed by a first name I would like them rearranged so that the full name is shown first name followed surname without a comma.
The end result in this example would be:
B2
Black Angel Blues (Sweet Black Angel)
C2
Robert Nighthawk
View 9 Replies
View Related
Aug 3, 2006
I have the following code which I know is wrong:
Public Sub WeeksOfSupplyatInitial()
'get the Instore Date Week add 2 weeks, then extract from Weeks of Supply
'and return the value to cell D4
Dim result As Double
Dim firstRowTotal As Double
View 3 Replies
View Related
May 13, 2014
My column extraction requirements are:
Using the same file you posted we just need column list; when we press ctrl+z the box should come up and have only columns list showing up and buttons like "select all", reset, and cancel should be present.
In this column list all the column headers should be shown under the column list and the interface box(ctrl+z) should be movable like you have already done in the last post
The other condition is that if any new columns gets added anywhere in the first row of the sheet the user interface(ctrl+z box) should show it in column list so when selected it can be extracted to the output file.
In short every thing is similar to the previous file samplecopy v6.1.xlsm you posted but this time only column list is required and all the column headers under it and remove the note which is applicable to previous query.
View 7 Replies
View Related
