HTML Scraping Using VBA
Jan 16, 2009
How can I using VBA do HTML scraping? A site which I have to use to update some data on a spreadsheet does not offer any web services. I have to copy data from the spreadsheet one cell at a time, paste into the search field and look at the results and decide what kind of modification is needed for that piece of data.
If VBA can do HTML scraping here is what I thought I could do. For each of the data in the cell, I need to go to a search field on a website, manually enter the values and hit search. Then the browser generates a url like "http://www.mysite.com/search?hl=en&q=SNX018923" and returns the result as an HTML page. How can I use vba so that I can automate this process of generating the url and load the returned html text into a variable. Then I can use the script to search for a pattern of text and do something to the active cell from where the data was taken. *nix has a curl command. What is the equivalent of curl in VBA? How do I use it to get the result I am trying to acheive?
View 2 Replies
ADVERTISEMENT
Jul 9, 2014
I have an excel sheet that has a lot of APN (parcel numbers) on it. I would like to run that through the assessors page [URL] to get the address and owners name. It seems like a very simple thing to do, but... How would I make it run each parcel through the assessors page to get the name and address information. Is there a tool I can install into Excel to make this easier?
View 7 Replies
View Related
Aug 7, 2012
In the past, elements were more or less fixed and was able to use my very well known method QueryTables under Workbooks.open
This website below has a "div", called "div.sidemeta" wihick contains the information I want to grab. [URL]
I have tried a different alternative:
Sub Test()
Dim IE As Object
Set IE = CreateObject("internetexplorer.application")
IE.Navigate "http://www.webiste.com"
[Code]....
The data I get under "IEdoc.body.innerhtml" does not show that particular DIV. I have tried using getElementById,getNamedItem and getElementByName without any luck.
View 9 Replies
View Related
Jan 20, 2010
I've recently switched from office 2003 to office 2007.
In excel 2003 I was able to paste html into excel for easy editing. In excel 2007, when I paste the html I see auto-formatted web page objects. How can I disable this and get just straight text?
I tried formatting the cells to be plain text and then pasting.
View 14 Replies
View Related
Feb 13, 2010
Trying to automate a job. I'm using this
Public Sub Test()
'Initiate IE
Set IE = CreateObject("InternetExplorer.Application")
IE.Visible = True
View 9 Replies
View Related
Dec 14, 2006
is there any way to accept the data directly on the userform(excel)? it may on some html control on userform or any other possible way to deal with.
View 2 Replies
View Related
Jul 22, 2014
I have a few hundred of these divs, that I need sort and filter.
I would like to remove ALL HTML and be only left with the following:
Example Name = KeithEmail = keith@example.comStore = Store 1 (This only has 2 options. Store 1, Store 2)
All of the below code is in an individual single cell, so there are about 400 cells
HTML Code:
<div userid=""286"">
<div id=""694"">
<h1 style=""display:none"">Keith</h1>
[Code]....
View 1 Replies
View Related
Jun 26, 2014
Below I have my code that works great. What I would like to do is make it pull the .HTMLBody from a cell value instead of inbeded in the code so users can change, just like to I have it below for who I am sending it to. The issue is if I do it the same way I loose my signature and the font, size and color I have below. How can I do this.
range("P16") would be the 1st line of the mesage
range("P17") would be the 2nd line of the mesage
range("P18") would be the 3rd line of the mesage
All the sendkeys below copy a range and paste it below my message as a picture currently. That is fine.
[Code] .....
View 1 Replies
View Related
Jul 23, 2014
So I have this code I'm working on for my deptarment that goes to a website inputs data , clicks run and downloads the csv file to the worksheet. It works just fine on my PC and on my profile on the computers the other department uses. We are both using same versions of windows, excel , and IE. When i have someone from the other department run the macro it opens the website but never enters the data into the fields despite the site being the exact same coding as when i'm logged in.
[Code].....
When this code is ran by a member of the other department it just opens the website inputs nothing and doesn't press the RUN button on the website.
What setting or anything. I verified that both PC's VBA references in are there and no "Locations are missing paths" .
View 1 Replies
View Related
Oct 30, 2007
I have lots of text with HTML tags attached, I would like to delete the tags and be left with only the text. Is there an easy way to do this?
eg.....
View 14 Replies
View Related
Jan 19, 2008
I would like to retrieve contents of a web page, be it HTML or XML, into VBA variable!
Later, I would chop, cut, parse or extract the data I need.
Both importing as XML or WebQueries is unsatisfactory for a certain number of pages I need. XML has bad schema, WebQuery tells me it can't find any data.
I tried with WinHTTPRequest, but Excel gives me back error "undefined user type" in other words it doesn't recognize that object.
Basically I want the source of web page to become a string in my VBA code. In other words that would be replication of funcionallity of
View 15 Replies
View Related
Aug 10, 2009
I have wriiten a macro in excel that pops up some photos whenever the respective cell is selected. It is working good except when I save the file in HTML format. Also what is the difference between publishing and saving html file? I am using office 2003 and microsoft web components installed.
View 3 Replies
View Related
Nov 6, 2009
I have a couple spreadsheets which update using a RTD link. I then use Macros to sort it and publish a html file every 30 seconds.
I found the html macro thanks to : http://www.meadinkent.co.uk/xlhtmltable.htm
The problem is that whenever I run two sheets together, the macro that creates the html file at times gets the data off the wrong worksheet. Sometimes I only see one sheet's data being used, sometimes the other.
Both html files when published have some feature from one macro and some from the other macro. Like macro one sheet says use 1528 rows and the title for page is Relative Strength Over 750K. Other macro says use 979 rows and title for page is Relative Strength Under 750K. I would have both the sheets as like 1528 rows for with title Relative Strength Under 750K.
If I run one sheet at a time, everything works fine.
Here are the Macro codes for Sheet #1:
Private Sub Workbook_BeforeClose(Cancel As Boolean)
Application.OnTime dTime, "Macro1", , False
End Sub
Private Sub Workbook_Open()
Application.OnTime Now + TimeValue("00:00:30"), "Macro1"
End Sub
Module 1
Public dTime As Date
Sub Macro1()
dTime = Now + TimeValue("00:00:30")
Application.OnTime dTime, "Macro1"
Columns("P:AH").Select
Selection.Sort Key1:=Range("AG1"), Order1:=xlDescending, Header:=xlGuess, _
OrderCustom:=1, MatchCase:=False, Orientation:=xlTopToBottom
Application.ScreenUpdating = True........................................................
View 12 Replies
View Related
Nov 22, 2005
How do I remove HTML markup from and cell.
i.e.
<DIV class=productdesc> <H3>SCALLYWAGS CHANGING MAT. </H3><TABLE border=0>
<TBODY> <TR> <TD> <UL> <LI>Foam-filled <LI>Wipe-clean surface <LI>Fits most
dressers <LI>dimensions: 75 x 46cm </LI></UL></TD></TR>
<TR></TR></TBODY></TABLE> <UL> <LI>When using a changing mat on a dresser or
other raised surface, never leave your baby unattended even for a moment
</LI></UL></P></DIV>
I want it to read:-
SCALLYWAGS CHANGING MAT. Foam-filled Wipe-clean surface Fits most dressers
dimensions: 75 x 46cm When using a changing mat on a dresser or other
raised surface, never leave your baby unattended even for a moment
I am trying to change out website csv file into a froogle csv file but
without the HTML
View 14 Replies
View Related
Apr 26, 2012
is it possible in Excel to read value from url every 5 mins.
this html url has a time which is updated every 5 mins, I want excel to read that time from that url every 7 or so mins. so after that I can write another code if time didn't change it will notifity me or do whatever I need to do after that.
View 2 Replies
View Related
Mar 31, 2008
I have a html file that is pulled into excel. It has several values like list below. I need the zero value to be blank. Is there a quick macro that I can run to get them to change over to blanks? I tried formating but that didn't work.
A B C D E F
1 35,080 0 128 2,028 0 0
2 20,586 124,680 0 25 228 342
3 1,425 125,879 22 0 0 0
4 0 0 0 0 0 0
View 9 Replies
View Related
Jun 19, 2008
I need to do seems quite simple, I want to grab the source of a webpage into a string (where I'll then to some fiddling about with it to strip it down to the information which I need). Currently I'm trying to do it using the webbrowser object and meddling around with the .document properties, but I can't figure it out.
UserForm1.WebBrowser1.Navigate UserForm1.address.Value
grrr = UserForm1.WebBrowser1.Document.body.innerText
UserForm1.sourceoutput.Value = CStr(grr)
View 9 Replies
View Related
Oct 15, 2008
I have over 40 workbooks that have a summary page for the products contained within each. I would like to extract the information on the summary page to an html format with all the html tags so that I may post the information within a sharepoint webpart.
I have the publication the sharepoint down, but the extraction to html is my issue.
The information is contained within a 2 column by 15 row section give or take a row depending on the workbook. I am not to worried about the format of the cells or sheet, just the content.
View 9 Replies
View Related
Apr 1, 2009
I have copied a drop down value from a HTML page to excel and this drop down is showing up in execl and I am unable to delete it by either deleting the rows or columns. What do I do to remove the dropdown value in the sheet?
View 9 Replies
View Related
Sep 26, 2009
If I copy for example from here ....
View 9 Replies
View Related
Jan 22, 2007
I need to convert my spreadsheet to HTML for my website and purchased SpreadSheet Converter. Since my spreadsheet results need to be SORTED and I used a macro to do this, I discovered this program will not work for me (as the sort function is not transferred and macros don't function.) Is there a program that will convert Excel to HTML AND allow macros to work (or at least the Sort function?)
My spreadsheet program requires input of price data into various cells; then on another page the results are generated and are sorted in Excel. The data only makes sense if it is sorted. Without the Sort, the price data is mixed up and not useful. Thus the web based spreadsheet will not work properly.
View 5 Replies
View Related
May 1, 2013
I need some type of vba or macro that can extract text in between html tags from a list of URL's.
For example
I have a list of urls in column A
Columns B,C,D,E - are where different types of information from the website will go.
So B contains values of text between a <title> tag </title>
C will contain values of text between a <object> tag </object>
and so forth ....
View 6 Replies
View Related
Sep 29, 2009
I'm using excel 2003 and was wondering if I could insert html around the cell data in a faster way than cutting and pasting it. Here is an example of a column and what I would like to do.
aaaa
bbbb
cccc
dddd
Now I would like every cell to have HTML around it to be easily posted on a website. I would like the cells to now look like this.
<a href="www.url.com/aaaa"><img src="www.url.com/aaaa.jpg"></a>
<a href="www.url.com/bbbb"><img src="www.url.com/bbbb.jpg"></a>
<a href="www.url.com/cccc"><img src="www.url.com/cccc.jpg"></a>
<a href="www.url.com/dddd"><img src="www.url.com/dddd.jpg"></a>
I haven't dealt much with functions so I don't even know if this is possible.
View 3 Replies
View Related
Feb 11, 2014
I am trying to parse a section of html into excel but I don't know how to parse into a new row with each pattern rotation. I can do this both in Word and notepad++, but I can't find the same function of replace-with-line-break in excel's find-and-replace box.
Original html extract:
"shb":{"landline":"£1","mobile":"£1","text":"8p","mms":"24p"},"af":{"landline":"18p","mobile":"18p","text":"8p","mms":"24p"},"ak":{"landline":"3p","mobile":"3p","text":"8p","mms":"24p"},"al":{"landline":"10p","mobile":"25p","text":"8p","mms":"24p"},"dz":{"landline":"5p","mobile":"27p","text":"8p","mms":"24p"},
Results I need:
Capture.PNG
There is only one line as such in the entire page, so I don't need to loop through "blocks" of html codes with multiple lines.
I have had a look around and not sure what would be a good way to tackle this. RegEx (how to do it in excel macro)? HTML tags parsing (but these are not strictly tags)? I need to extract the correct section from page source as well, but I imagine this shouldn't be too hard. The url to the page I am extracting from is [URL] ........
View 3 Replies
View Related
Jul 24, 2009
I need a macro to export a range of cells to .html. The Save as Web Page works fine for me except a few thing that I need to automate. The macro I use now looks like this (recorded):
View 3 Replies
View Related
May 13, 2009
I am familiar with VBA, but this one has me stumped! Basically, I want to have Excel fill out an Aspx form, submit it, and then pull in the data from the html table that the form produces. There are multiple queries it would have to do, so I would want it to loop through until it is done with my list of inputs. I don't even know where to start...
The website I need to pull data from is: [URL]
On the form, there are multiple fields, but the one I am interested in is the "Study Area Code." An example input I would have in this field is "529910." I would have a different sheet in my workbook with all the SACs I need to pull.
My vision for the end result is to have all the data pulled into one sheet.
View 9 Replies
View Related
Apr 18, 2011
I have roughly 100 HTML files, each containing a single table of formatted data (created with the SAS statistical software package).
I realize that I can open an HTML file with Excel, do what I need (e.g., copy, format, save as an Excel file), but I would like to try to automate the process, if at all possible, even if it's simply open the HTML file and save it as Excel. That would save me quite a few clicks it seems.
Ideally I could pass a directory name to Excel (via VBA) and have a series of "operations" (i.e., save as an Excel file) performed on each HTML file in the directory, ultimately resulting in a corresponding collection of "new" files (in my case, Excel files).
If this was very fancy, I would love to take each HTML file and copy the one table in each, and paste into a separate worksheet in a new Excel file (so 100 HTML files would result in one Excel file with 100 worksheets).
I did try to generate a macro while using the Import External Data "tool", but didn't have luck with that (although I am able to get the tool to work, just not within a macro environment).
View 9 Replies
View Related
Jan 20, 2012
So I have a few thousand .html-files that i need two lines from. It is line 43 and line 46. I want those lines in each cell and the dokument name in the last cell. After that it goes 1 row down and takes the next html-file.
So it would be something like:
Row 1 | line43 | line46 | Dok1
Row 2 | line43 | line46 | Dok2
View 3 Replies
View Related
May 9, 2012
My application has a information that is constantly displayed to operators. In one of the non-active sheets, is a log of what is happening and I need to export this log in a (prefereably) .html format to display on an Apache web server.
The monitored sheet always have to be visible, and I do not want any dialog boxes popping up, so the Sheets("log") has to be exported under this criteria... Only need the first 1010 rows exported to the html file.
Would all of that be possible?
View 7 Replies
View Related
Jul 22, 2013
I am trying to use VBA to send emails in HTML format including hyperlinks.
I am using the syntax HREF = ""....
View 4 Replies
View Related
