I'm trying to enter text into a login page. The login page is:
https://ppair.uspto.gov/TruePassSample/AuthenticateUserLocalEPF.html
using "inspect elements" in Internet Explorer (the website only load in Internet Explorer) it seems to me that the name for the "select Digital certificate" text field is: "username"
This is my script:
import os
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
# Digital Certificate Path
DigitalCertificateFolder = 'C:\FOLDER'
DigitalCertificateFile = 'FILE.epf'
DigitalCertificatePath = DigitalCertificateFolder + '\\' + DigitalCertificateFile
password = 'PASSWORD'
# get the path of IEDriverServer
dir = 'C:\FOLDER2'
ie_driver_path = dir + "\IEDriverServer.exe"
# create a new Internet Explorer session
driver = webdriver.Ie(ie_driver_path)
driver.implicitly_wait(30)
driver.maximize_window()
# navigate to the application home page
driver.get("https://ppair.uspto.gov/TruePassSample/AuthenticateUserLocalEPF.html")
# get the search textbox
Select_Digital_Certificate = driver.find_element_by_name("username")
Select_Digital_Certificate.send_keys(DigitalCertificatePath)
This is the output from inspect element in Internet Explorer:
<INPUT name=username style="CURSOR: auto; BACKGROUND-IMAGE: url(data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABAAAAASCAYAAABSO15qAAAABmJLR0QA/wD/AP+gvaeTAAAACXBIWXMAAAsTAAALEwEAmpwYAAAAB3RJTUUH3QsPDhss3LcOZQAAAU5JREFUOMvdkzFLA0EQhd/bO7iIYmklaCUopLAQA6KNaawt9BeIgnUwLHPJRchfEBR7CyGWgiDY2SlIQBT/gDaCoGDudiy8SLwkBiwz1c7y+GZ25i0wnFEqlSZFZKGdi8iiiOR7aU32QkR2c7ncPcljAARAkgckb8IwrGf1fg/oJ8lRAHkR2VDVmOQ8AKjqY1bMHgCGYXhFchnAg6omJGcBXEZRtNoXYK2dMsaMt1qtD9/3p40x5yS9tHICYF1Vn0mOxXH8Uq/Xb389wff9PQDbQRB0t/QNOiPZ1h4B2MoO0fxnYz8dOOcOVbWhqq8kJzzPa3RAXZIkawCenHMjJN/+GiIqlcoFgKKq3pEMAMwAuCa5VK1W3SAfbAIopum+cy5KzwXn3M5AI6XVYlVt1mq1U8/zTlS1CeC9j2+6o1wuz1lrVzpWXLDWTg3pz/0CQnd2Jos49xUAAAAASUVORK5CYII=); BACKGROUND-REPEAT: no-repeat; BACKGROUND-ATTACHMENT: scroll; BACKGROUND-POSITION: right center" type=text size=38 lpcachedvisval="1" lpcachedvistime="1491220212">
When I try to run the script in the console to receive the following error: "NameError: name 'Select_Digital_Certificate' is not defined".
Can someone please explain to me what I'm doing wrong?
Required input field located inside an iframe, so you need to switch to that iframe before handling input:
driver.get("https://ppair.uspto.gov/TruePassSample/AuthenticateUserLocalEPF.html")
driver.switch_to.frame('entrustTruePassGuiFrame')
Select_Digital_Certificate = driver.find_element_by_name("username")
...
To switch back to main HTML document you might need to use
driver.switch_to.default_content()
Related
I have read all the available answers on stackoverflow related to my query but no answers is solution of my problem. I am trying to upload a document from desktop using python script but script gets failed in between with Exception. Scripts throws Exception in following python code
frame1 = driver.find_element_by_id("BrowseButton")
driver.switch_to.frame(frame1)
document_to_attach = wait.until(EC.element_to_be_clickable((By.XPATH, "//object[#class='swfupload']")))
document_to_attach.send_keys(r"C:\Users\Desktop\sample.msg")
Exception is
selenium.common.exceptions.ElementNotInteractableException: Message: Element <object id="SWFUpload_0" class="swfupload" type="application/x-shockwave-flash"> is not reachable by keyboard
HTML Code corresponding to this element is
<iframe style="position: relative; top: 5px;" border="0" src="DocumentUploadForm.jsp?DocID=21UZZZQ5UGKEZN5OBTZQ51JZR1BJD3ZZ&maxNumFiles=3&Time=1584360999619"" name="BrowseButton" id="BrowseButton" scrolling="no" width="100" height="32" frameborder="0">
</iframe>
<object id="SWFUpload_0" type="application/x-shockwave-flash" data="swfupload/swfupload.swf" class="swfupload" style="" width="20" height="20">
<param name="wmode" value="transparent">
<param name="movie" value="swfupload/swfupload.swf">
<param name="quality" value="high">
<param name="menu" value="false">
<param name="allowScriptAccess" value="always">
<param name="flashvars" value="movieName=SWFUpload_0&uploadURL=%2Fhome%2Fgold%2Fjsp%2FDocumentUploadReceiver.jsp%3FTWCSESSIONID%3Drmgw946kr5mi46v8srwuewbs&useQueryString=false&requeueOnError=false&httpSuccess=&assumeSuccessTimeout=0¶ms=&filePostName=Filedata&fileTypes=*.*&fileTypesDescription=All%20Files&fileSizeLimit=64%20MB&fileUploadLimit=3&fileQueueLimit=3&debugEnabled=false&buttonImageURL=%2Fhome%2Fgold%2Fjsp%2F&buttonWidth=20&buttonHeight=20&buttonText=&buttonTextTopPadding=0&buttonTextLeftPadding=0&buttonTextStyle=color%3A%20%23000000%3B%20font-size%3A%2016pt%3B&buttonAction=-110&buttonDisabled=false&buttonCursor=-2"></object>
This is the image
Manually if I open website and uploading the document, it is successfully browsing document from desktop and uploading it. When I am using selenium script with Firefox Web Browser , it is giving the above exception. While running automation script, if manually I am trying to click this element than also I am unable to click it and it appears as an image on browser.
I think it may be related to Flash object or some plugins or something else.
What is the reason behind this exception and how to solve this exception
Use presence_of_element_located. The element you are sending text to may not be clickable.
If that does not work try the commented out like that contains WebDriverWait(driver, 10)
from selenium.webdriver.support.ui import WebDriverWait
frame1 = driver.find_element_by_id("BrowseButton")
driver.switch_to.frame(frame1)
document_to_attach = wait.until(EC.presence_of_element_located((By.XPATH, "//object[#class='swfupload']")))
#document_to_attach = WebDriverWait(driver, 10).until(EC.presence_of_element_located((By.XPATH, "//object[#class='swfupload']")))
document_to_attach.send_keys(r"C:\Users\Desktop\sample.msg")
The reason behind the exception is due to flash used by website.So added the following line of code-
firefoxProfile = webdriver.FirefoxProfile()
firefoxProfile.set_preference("plugin.state.flash", 2)
driver = webdriver.Firefox(firefoxProfile, executable_path=r'drivers\geckodriver.exe')
Also after it, automation script was not giving path using send_keys and hence found solution to use pyautogui library or autoit library. Following code is used for this purpose-
frame1 = driver.find_element_by_id("BrowseButton")
driver.switch_to.frame(frame1)
document_to_attach = wait.until(EC.element_to_be_clickable((By.XPATH, "//object[#class='swfupload']")))
document_to_attach.click()
import time
time.sleep(5)
import autoit
autoit.control_focus("Open", "")
autoit.control_set_text("Open", "Edit1", r"C:\Users\Desktop\sample.msg")
autoit.control_click("Open", "Button1")
You have to install autoit module in case if you do not have it by pip install autoit
I am trying to collect email addresses from a form on a website that has readonly inside of it.
<input name="email" id="email" type="text" class="form-control" value="example#gmail.com" readonly="">
I want to be able to get the email address (example#gmail.com) but everything I try returns "unable to locate element".
Everything is configured properly as the rest of the script is working fine, which I have left out.
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from bs4 import BeautifulSoup
import re
import pandas as pd
import os
x = 0
all_volunteers = driver.find_elements_by_xpath('//*[#title="View volunteer record"]')
for volunteer in all_volunteers:
volunteer.click()
driver.implicitly_wait(3)
# email_add = driver.find_element_by_id('emaillabel')
#email_add = driver.switch_to_frame(driver.find_element_by_name('email'))
#print(email_add.get_attribute('email'))
#email_add = driver.find_element_by_css_selector('input id')
#email_add = driver.find_element_by_xpath('//input [#name="email"]')
#email_add = driver.find_element_by_tag_name('Email Address')
email_add = driver.find_element_by_xpath('//*[#id="email"]')
print(email_add.get_attribute('value'))
# back button
driver.execute_script("window.history.go(-1)")
#increase counter by 1
x += 1
Everything commented out (followed by #) is what I have tried.
Is any one able to tell me what I am doing wrong or missing?
I have a debugging solution to locate the element.
In the browser, open the web page containing the email input
Open developer tools (F12)
Open console tab in the developer tools
Type $x('//input[#id="email"]') and see if the element is located. This is the native xpath locator
You can also try document.getElementById('email') in the console
If the element is not found still, try the iFrame selector marked in the screenshot to identify iframes and switch to it.
If more than one element is returned, it means that you might have to modify the selector to find unique element.
I am writing a python script to input text, that then has a dropdown appear to select from a list of items. These items are all hidden values and are not inputted to the webpage until selected by clicking on said item.
Specifically I am attempting to input data on Fitbits website to track food (a thing for work, but it is tedious to input food consumption each day). I would like to automate this :)
My script currently looks like this...
#! python3
# fitbitSubmitFood.py this script submits the food log on fitbit.com
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
browser = webdriver.Chrome()
# open webpage to log food
browser.get('https://www.fitbit.com/foods/log')
# login to the website
# email username input
emailSelect = browser.find_element_by_xpath('//*[#id="loginForm"]/fieldset/dl/dd[1]/input')
emailSelect.send_keys('EMAIL')
# email password input
inputPassword = browser.find_element_by_xpath('//*[#id="loginForm"]/fieldset/dl/dd[2]/input')
inputPassword.send_keys('PASSWORD')
# click log in
clickLogin = browser.find_element_by_xpath('//*[#id="loginForm"]/div[1]/button')
clickLogin.click() # clicky click!
# input What did you eat?
foodSelect = browser.find_element_by_xpath('//*[#id="foodselectinput"]')
foodSelect.send_keys('Pizza, Bread') # select by visible text
# input How Much?
howMuch = browser.find_element_by_xpath('//*[#id="quantityselectinput"]')
howMuch.send_keys('3')
# click Log Food
logfood = browser.find_element_by_xpath('//*[#id="foodAutoCompButton"]')
# logfood.click() # clicky click!
# Close web browser
The current script above throws the following error.
selenium.common.exceptions.InvalidElementStateException: Message: invalid element state
So I have also tried suggestions from this stackoverflow question.
Entering a value into a type="hidden" field using Selenium + Python
WebDriverWait(foodSelect, 10).until(EC.visibility_of_element_located((By.XPATH,'//*[#id="foodId"]'))) # wait for hidden text to populate
This threw the following error...
selenium.common.exceptions.TimeoutException: Message:
Here is a snippet from the website
input type="text" name="foodselectinput" id="foodselectinput" class="text columnFull yui-ac-input" maxlength="80" tabindex="1" autocomplete="off"
I can see the following on the website for the hidden value. This value is not passed to the webpage until after the food is selected from the drop down menu.
input name="foodId" id="foodId" type="hidden" value="13272"
Note: I have already tried using the click method for the Pizza, Bread
clickFood = browser.find_element_by_xpath('//*[#id="foodselectcontainer"]/div/div[2]/ul/li[1]/div/div[1]')
clickFood.click() # click it!
This did not work.
selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"xpath","selector":"//*[#id="foodselectcontainer"]/div/div[2]/ul/li[1]/div/div[1]"}
The script cannot continue until the food item is selected on the webpage. Hence, the question.
How would one pass the hidden value or select from a dropdown?
From your snippet
input type="text" name="foodselectinput" id="foodselectinput" class="text columnFull yui-ac-input" maxlength="80" tabindex="1" autocomplete="off"
yui-ac-input refers AutoComplete from YUI 2 Library (That's what I thought)
As the site mentioned by you asked credentials. I created a sample code for YUI Example
Sorry I dont know python.Below is a Java code. The syntax looks more or less same. So get the idea from below code and implement it
public void start() {
driver.get("http://yui.github.io/yui2/docs/yui_2.9.0_full/examples/autocomplete/ac_basic_array.html");
yuiAutoSuggestSelect("Cali");
}
public void yuiAutoSuggestSelect(String value) {
WebElement inputElement = driver.findElement(By.className("yui-ac-input"));
inputElement.sendKeys(value);
By autoSuggSel = By.xpath("//div[#class='yui-ac-container']//div[#class='yui-ac-bd']//li");
WebElement autoSuggestEl = driver.findElement(autoSuggSel);
WebDriverWait wait = new WebDriverWait(driver, 10);
wait.until(ExpectedConditions.visibilityOf(autoSuggestEl)).click();
}
I'm trying to pull urls of images from Google Image Search results. As you know from using Google Image Search you click on a small photo in the grid to get a bigger image to pop down below it. This is where my Selenium Chrome Webdriver stops.
I've tried the .click() command and the .send_keys(Keys.RETURN) command. I've also tried the .send_keys(Keys.CONTROL + Keys.RETURN) command to try to open it in a new tab.
There are four different elements under the search result of the small image I want to click on in order to get at the full image. Three of the elements return a
"selenium.common.exceptions.WebDriverException: Message: unknown error: cannot focus element"
The X-Path in the code below doesn't give that error but it doesn't do anything. Terminal just goes back to the $ prompt.
I can't seem to get the photo and buttons below to pop down for anything. When I tell Selenium to do things to elements in the menu I can't get to open it says the element is not visible.
I don't want to use their API because I need more images than their API limits.
Here's the code. I'm thinking of another option below this code.
import requests
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.common.keys import Keys
list3 = ["rags and scraps"]
#Setup The Automated Browser (brew install chromedriver)
options = webdriver.ChromeOptions()
options.add_argument('user-data-dir=/user/anthonycelio/selgoog/chrome_driver') #Path to your chrome profile
driver = webdriver.Chrome('/usr/local/Cellar/chromedriver/2.27/bin/chromedriver')#, chrome_options=options) #Type 'brew list chromedriver' to find path
driver.get("https://www.google.com/search?q=cats+and+dogs&safe=off&espv=2&biw=1599&bih=726&source=lnms&tbm=isch&sa=X&ved=0ahUKEwiI56_7isXSAhXC4iYKHcbZCLEQ_AUIBigB#q=cats+and+dogs&safe=off&tbm=isch&tbs=sur:fc&*")
for i in list3:
driver.find_element_by_xpath("""//*[#id="lst-ib"]""").clear()
inputElement = driver.find_element_by_xpath("""//*[#id="lst-ib"]""")
inputElement.send_keys(list3)
driver.find_element_by_xpath("""//*[#id="_fZl"]""").send_keys(Keys.RETURN)
driver.find_element_by_xpath("""//*[#id="rg_s"]/div[1]/a""").click()
This might be a different option to store the url of the image if Google has made their images unclickable by Selenium: One of the elements has the link in it if you copy the outerHTML. The problem is they have stuffed code into the link. I wonder if it can be removed with any consistency.
<img class="rg_ic rg_i" data-sz="f" name="ziffAZE9s2oycM:" alt="Image result for rags and scraps" jsaction="load:str.tbn" onload="google.aft&&google.aft(this)" src="data:image/jpeg;base64,/9j/4AAQSkZJRgABAQAAAQABAAD/2wCEAAkGBxQTEhUUExQWFhUVFxcYFxcYGBwcHRgWHBQYFxcYGhcYHSggGBolHBUXITEhJSkrLi4uFx8zODMsNygtLisBCgoKDg0OFA8PFywcFBwsLCwsLCwsLCwsLCssLCwsLCwrLCwsLCwsLCwsLCw3NywsLCwsLDcsLCssKzcsNyw3K//AABEIAMUBAAMBIgACEQEDEQH/xAAbAAABBQEBAAAAAAAAAAAAAAACAQMEBQYAB//EAEEQAAEDAgMEBggDBwMFAQAAAAEAAhEDIQQSMQVBUWEGEyJxgZEVMlKhscHR8CNC4RQzQ2KCkvEHcsIWU6Ky0iX/xAAYAQEBAQEBAAAAAAAAAAAAAAAAAQIDBP/EABsRAQEBAQEBAQEAAAAAAAAAAAABETESAiFB/9oADAMBAAIRAxEAPwC/w+yi9ocHATyRnYjvbHkVO2Wfwm+PxKmyvNtdFH6Dd7Y8ildsN3tDyKvEqbTFB6Dd7Q9670G/2m+9aAAIU2mKE7Cf7Tfeu9Av9pvv+ivpRSm0xnxsF/tN9/0XegX+033/AEWgaUpTaYzp2FU9pvv+iT0I/wBpvv8AotBKFPVMUPoOp7Tff9Fx2FU9pvv+i0LUqeqYz3oGp7TPM/RcNgVOLPM/RaQIldpjMnYFTizzP0XegKnFnmfotM5IAm0xmXbBqcWeZ+iT0JU4t8z9FpnJIU2mMw7Y1UeyfH6hcNj1eA81pwEabTGX9C1eDfNIdj1eA8wtNVqAXJA71Cq7RpCZe3cfor6XFN6Hq+yP7gi9C1eA8wrWltai4EhwPL6IhtanBM+CnoxU+hKvBvmk9C1eA8wtBhsW1/qmVJT1UxlTsarwHmFBrgtdlIvE2VztjaJzFjSMsXOt+FtFSU6rHGJBI8OGiequED+RStcnajpBtp3KNh3TM6pPq2ljS7J/dN8f/YqeFX7J/dN7z/7FTwU/oWEYKbJRNcgVIVxK6UCJZXSkQKCiIQNKMlALyhCR5StCgUFHmQZV0KhwFEwpuUbUDhKRISuQCUoC5M43EBjHO4CYQPLP4zb5aXREA+KZxfSDM0BupEO/RZrFVDMyeagscRth7zJiASQPqq6vVJknU/DdCjCoDaSic7gL98eCipHXjdb75FI6vBBkkD7hMgtyiBBMnv8AuFIFCYMWO9EW2zdpub6txvlaf0vSGWXXPuPNYvDUS2dY+7KPVrcLSb315+5UaHbON6wVOqZLQIL9Dz8Pis0126OCI4p2XKDYm4nVRRXIJjQjT9dVFSA46ERHw0Cn4IWKqalYmDCsdlvkO7x8FfnqVp9ln8PxPxU5rlA2Uex4lS8yXoelcHIMyUFA5nXSmwUkqhwlLmTaMBAQSlyCVxcgEuTrFH3p1pQPRdcmX4prbE+CZO06Y1JA3W17kEwBGFX0trU3QJN1PDhxQKSlBUSpiwIIuCYkXjyUXEVRUiJgeE+BQSdoY0U2lxEjluKx+0tqF5km3BHtun2omANbiQqarTBvPuUCftd+ymwSTeyKkzLMgEdyUvBs2YnT7CBBSATjqILbHcNRz5IWtGhiF2axGbTggFlEd8aBahmGp9WCH9oCSIBvqRfRZmiDqLR9wAlxWIiLEcYQWFPEHNBmPIX+/co9emS60RFo5fPRA2pvPfPfr9EVUmZ3RoN0WUEd6WmzWdNyPlv3yfJIHx8UEeq7du4q02PGUxxE+SqsQ8fqrHYXquniPgrOlanZZ7B/3H4BSZUPZh7J7/kFKKl6HmFFKBqXNdApK6UoAPI8OKRUEE1jcY2m3M7w71D2ltEUxG8iyy+Jrl5u4kcJQWNbbT3Gxgcvqkw+13sMzmEaEqqZRi6i1q86WQauj0gbcuB7gnRt4F0AECL23+axlBx1CsqVSBKC3qY4A2Eg27RPmLqK6pJvoonXklTMhI0JPLj4IG6lQ/lF+Q5qQMWWAucS0AgOF5B1Ajmo9XZFc021C4A5ZNNohzDzN8zgo2x8PVqUqzb6nM6oHSHWOW4uXe1ulBPo1OqJbTPZDiS5zpGZwzAgRaQZIQv6Qubm6wFlxcMMROut7A6b0fRzCucXCo5z2sPZzZZENsAQTIvYkblZ7Zwbaj6eftMAJyvgy4byCghY6i13byl0kFpEgkQolWg13q9hx3wCQePaspTyAcxIESJJsB9hVeLORpcDJzCQ0Em8H4fFQOYnZjxL2EEQJG/S8DQidwVO2k6ZtqtDhdp02wahgATcGD4xE30lS6+KDXAZc1F0FrwJySfzDXWbjxQZKoIEHX5cE5SdaIVh0lolpYcxeCLTFjPIQNVR5omCqJtOpuOmqZq1RnkcfsqG7EGdSlbdBKp1DeTbfPmVNZVzKA0iI94Rh0IHal/NG4QeREymOsQGp9FAld3AffJW2wPVdExIie5Usq42A+Q/vHwVhWo2a0lpgE33dwUssd7LvJF0ed2XWntfIK26zkUsFY0HgUNSoGgk/BWzag4FLnCYMpU2g4zBjggbtVwsbrWEN3geSB2HpHVjP7R9FcHnu0sdneSRHAclAHFelu2Xhyf3VP8AtCbOwcMf4Tff8inkecOfNio9dkG8XvP393XpFTo1hT/Dg8nO+qjv6I4Y7nf3n5pg8+o23qVRf5LZHoXQ3OqDxH/ylPRCmNKjxHHLbnomDKVKoYC4wGgEq32PXeW9c8mXCGtmzWd2gJ+ipNrYCjVqNo0sQaupeQBEC+XOJk/on+i9MV69SiWsZRDHdlog5iGgkn8xiRJTBe1q7m5SyXvd+WbZePnfSVH2kxrKLX9llQuaXltpk9rny5Kg6TA0cW/q3uDmtBNiQBlnSbW3KDs6cRWYxpc8zLgQ5oa3eb96mDW7Hx7WkMbUBJmGuJJcbkQ48vgpG0doh0mCC0AGRo7UjnqPJBtTDUupMMByuYBMF2skhxGsKu2a5vVkHMW6Aus4REOdGswb80DXWZmPbOrjbx0Q4emOqzcfjwTFeKdRze12uXK5BU7Z1eG5QJG/Sfcgl7DptIqNeA4Oykg6b9BuuixkN7DA6ROUi8AmSIJnL325qpxW0TRe004NzIIkH/c78utuaj19uS+p+K2HXa0mC0x2mmN2sb9EErEYkCm4S7suGdti09qMwdeI75tdUeKa0GWOzNkgHuS4Oo5zHNzwKgcR2bW7Ivv1QuphtNrQLySTzO73IIrgE41E/DuiYMLgwakoCpuRl6B4AFimwgeFT7/wmzO9ciZrCBprCToY9yvujzbP5kfBQXPOgJiAbcICm9HnyH94+BSFbbo4ey/vHwV0qXo4yWv5EfBXLHg6LQUFFCTKiLUGax3SgNrdVSp5yDDnEwAd4HFSX9JqOWwc585eraO1miSOFuKynSLYT8M/O1zuoc6bG7XG8OPCd6r9kCvUqVMS2meroiDJMnQktG8xc8lP0bR3SVovUw9VgnWARHMhTtm7TpVo6sg/HyUXZOJbiGAi48DyXnOOwtfC4ggdhwOYFpMQSSLwmj2E0wh6oc/NY/oj0qqVnmlWyzuMw467vzeHvWzBWgAp8yqbpftQ4bDl7SC4kANI9YaO7hzV8AqfpbTnDVCGZ3NEtGsGPWiRMcEowGAqDJTLabmOpTLT+ZrvzSBE8iEz0O2sGYizLvfULjeQMoyN4SXXVU+qAHS4uN3OzEzMAX3b4j/KgNJbRDgXNJcXS20CY3LOI3+2Nn1BWNVzGhziQCHG4iADbcFFwez30a3WtLgCDLXOkluXdbTRV2B66u8l1ao+mWzmLzYmDAE9l2qfZtISaVBxLxZrnkuDnDVuYm7omN1oUVb13VA0BpDYcHGdBA3DnqqujUe0uLq9I5nExEamYF7wslVx2Je501HuIJBg630AHyVgHVRQae0TnJsTOU05mf6VcF7jH1iPwxTdExJPCIsNVV4LCVyS57BwtUIg3k5Wjnv4KJs3EGo6C54Mh05vygS8E7xAPmn8Dtw5y0kuHacSQJYNwBm/imC9w4e6i+k1rczoDuQm5zEzb4qvxnRLFFtSox0sILozC4G4D/CWjTkGpSqFwMSL5mmRIEGIN9ZQY3b2LpUura8tYMwlrQd/tEEgXGnFIJvRnCsJotdvERAs2TPfJ+C0HTMZKTWUBJc8CpHrZYkWF4mFjsHhajqTQ0Fz+rJgXMh0+qodPpBUY45yS4Egzx7tyDZ7A2Y5sPe2RqAY94K0OHqYV5AdRptJjVjYnhMLz+h0oa6AZNwbDVWlDbhJ9Qi+ptPgp+jcnYOGP8Cn/aB8Ey7oxhD/AAW+BI+BUnZGJFWk11p396mlgWhSu6KYT/tf+Tvqmj0Pwsg5HCL2eVehspcimDOv6F4Y+3/d9Qq7GbEp4UgUy457nMQdOEAcVsHM5lUHSNsFn9XyQpzYM5Xwd4+BVhRcWndfn+iqdjOMOjiJ96nvLvZ96Xon9bzHmnGvPLzVOCfZKdpvPApotCeS4nkoLKnGUeJx9OmJe8NHElXRkdt7MqYWpTdhx+A6p2m3/DzG4EWLTz0Kpum23IqUwwkPaDng2y7gRpMq26VbaLmEg9kCabdS90xJA0WD2vsuszK+pDjWGYQQ46A3A0NwFJ1DdPbJz5qjGui4I7DgRoQ5kX816rsLb761BtUU3FpkSILpBg5m2zd4Xjr6J3NPkV6/0Pw/V4SiwkTlzEcC4l1/NWkX2C2pTqWBGbh+huO4qY4iFW4jAU6lnta7nFx3HUKPjOsotJZ+LSA7TDIqAR+V/wCbuN+auq8i2xTacRVygCmD+XTy70mGDnspUqchzrkgkRJ3xu3o8fhXPFWpTEU8wF7HmOffyUvorRLWvqxZgy95ibfe9T+In7QpllEU6PqM/eQe1reSNJ48kxSwQyte2o4i0XFu18R8kNDHNNSZLXQdZBBO73KRLQSD2A4jtfkJnePyHmLHksqi19mzVD8xAMg5QLPFyNNHDtDxG5FjcOTSDQSMzqfPUVGnXTRSMTierrgO9R7Q12sC5LXg6GJ3bpT1MQ57Ha020/Pt6f3Khuhs4CnUYHEHLkD7TeCd3C3iqSjgy2qGC+uYiNONxAV9iMST+EwdvVx3N4k8xYeCbqYUBnVt/MDmcdSd19w5IFwtMU2h1N0gGXWHbm0W08ApG0HN6p9QOdn1Hqw0DlEzzlVWyQ8BzI7Nr8Libq0xuEDw8De06cfuFBa9Br1aYJn8MunfJAkl3yWq2r0ZwuIM1aIc72gSD5tIlZHoJUa2o1xIA6oCSd9rL0FtbMJbBHEEfVag866cbEoYYYfqaQZmc9pI1MgRJMkqgOJIDQeJt9+K3X+oNIuoMcRZjwSbWkQDrxIXnOLqAucNXDLF995UHoPQ/HCQAbG3juWzLOa8p2DWhs8XeVrac16LsjaBqU7i7bE8UgsA2F0Jp1eBe3eup4lrtDKocgrP9Jm3p/1f8VfdYFRdJz+7/q/4qFNbDPr+HzVsCqjYh9b+n5q3a5L0hWwkyyjATFeuGoHimqtJrwWuAIOsqG7aCH0nwhNEfGdE8NUizmR7DiJ75lYf/UDCU8PVp06EtJYXO7RMyYHrE8D5r0Fm1f5ZXnnTzDOOK64+o9rQDwcBGU8OPirMRlDi6gN3Er1LZ3RGi+mx4qVhma06t3id7V5iLlez9HsW04ejf8jfhCUiG3og0aV63m3/AOU8OjRGmIrDxCu+vHELi9PxWS210XcaQYx+aT+YAXPMKHhtlHD0atIlrjTa6o6JAMXgb5iAt2HKlxlDNVqt9umR5tj5KUYHraOIZJDmE6AdoxviWx71ZbOxWAps6uo2qeJqBxnysB3K96F40MwbGVOy5hc2CDJhxiBvT21Nq0/V6nrHHRjmguPcyC4DmYCCl/8Az3tLW1BlF8hJIniJMjwhULccxzy4tdldHqzZgMNN596ucdsRjWmrXpU6ZiW0aep/3PFm9zRPNVOC2DV6xlN4ZeSLmQAA4t8JhBbbOwoZmce22TbMxucm+Zz3OBOtgIA5pg7QZ6sDNwbWpEjuDS74K5pbOo02tqVHPyPgZg4gMdpBA3TvUpuyHsksea1NxmJyuHcRZ3jCgyeJwVV4c80sT1bWkkue1oEbxmptkRwR4N9QVWB2UNLAW5bhwMgOk8R3blo8Rimsc2nSl9Zx/duaOzzc46BRaeAFMusDBDc0k31IbO60Kiw2VsAOZL84n1cpbGXUHQ8VocDTFJmRgdFzJIJS4UQxo4NHwTmYIGMdTFWm+m4SHtI8wvH9pbAr4dpqVWgAOygzJO4GBuXs7lj/APUkzhQD7bUKxmCx5a2BvG/jxXpHREOp4cZ5zVCXmeBgD3Aea876O4E1atNgEguE/wC0Xd7l6yeEIG9oY3s28VEw+12tJme5TsvJE6mDqAfBQJhtqteYAgqt6RPnJ/V8lNdgmaxB5WVZtikG5YnU6lJ0qvbtDqrkwDy4f5UvD9ImnUt94VZjKT3NIY2TH+FX4HZdUMeHUzmOh3BL0jZM21TO8eYTGKxdNxkPHcskNlYkfwye4j6qNW2diTpSf7vqg1LsWNxXPxA3KgwmFhkPpPDpMkt+eirK9J4Jhr4G8X+CDYtrgeWqibVp9bRc077jvWQdinCO04eaOjjam5z48fkmDPVOy4g2IkLY9FtvtY0UqpgD1XXtyP1WYxtPNUkh0nWePipNOk5oLhAm1xOutluo9P60RY27002sbmdfgsLh9sPpsa1rpA4jmi/6kq8j4BYxXoWHxjhaZ70mMxDXOaSLxBg7vBYOj0mqTo378VN/6hcQew3wJQTMRUNHGFhrPZh64kOFy13sBzpLB3cQtNR6mi0togZna8Sfae43PeVm8UKeIozEtFzrLSOEKp9MzNMiGmBmBuW8DOneqNdhsOKjjVf22U7g/wDcqDfHsNNgON0VPCDrmu30sgn+Z+Yv+IUUVmtptizWtzQDIgeqJ3pvZ+0naw7tvzEmIEbvcoLPAYTJ11KpDmOeY5ZrxHBRqeJ6up+z0e072gbNHOfzBA/pC1+e24XjQjfqnaGMoNpdlhBN5G93Ek6IHaWHo4em45S6q67nOu5zuM8Agbh5LKXi4cN593xUfrSfxajpdEMaNBzP3dWWyaWUZ3mXO15D6oLVC5D1reISh44hUFKznTvZ76uH7AksdmjiBqtAHRvUbajvwaka5T8EHl3R3a5w7w9sHc4cRv5gr1TZ2NZXph7DIO7e07wV4dSYc0aHd9Fpui+2n4eoJBLXWcOPdzVo9VaEUKPh8Yxwlpn5J4P4KBSOaqdvaN7/AJK1dUA1VVtxwLWxftf8UnRW4cm8cvmpbHnkouGbr4fNSZU+uiTRed9ktRx1hN06nNPB6gCnMaDxQvwzSLsae8J6UQqBUQamAYRZgH3uGiiV9hhxs9zfIq4c4d6IO4oM9iejQfHaAji2SfMom9H6cQQ1x4kfAAgBXla49aO79Uy3vQUvoGnGXI0DiB9ZUWv0donQRx7PwhaaZ7kuQEQLIMc3YVFxs0NjgXA/+SmU+jtEmO0I/mB+K0L6TRbenmUmR6oKDP7M2S2m5zmPqD+Uix++SWtgWOmW5Z1sIJ8Qr52Fp+yPvuQ/sLI3/wBxQU7sBNOJAB158NF2GoFrQMwy5uPiQLcx5q2bs5sWc4eP6Lm4Mx658ggq/QrZLpFzp+iRmzoDmue0tOgaI8FYM2WTcvPduUqhhYaQIHcEFbVwjxGVgIGnaHvlK5tX2I7/ANFZBpLeKSm2RzHNBWUi8mI9zvonocN0+P1U00ybjULiCdNUFe97xo2f6m/VMYvG9lzHQ0kb3D4Akq1LCdw5iyY9E0iS7q2zvQeet2MXOBzNaQZBJMnwhTaFA0qjex2jx56EBa9+yaRn8Pwk/JH+ytzB2WSLXuQOUpoytepUzQGP7wDqhbiKwP8AE962pdP3f9UYdI+wUGPbtZ4sXvnvKewWONQwXE6mD5LS1GiIgGeQVfi6TRBAgpOgKQ4pwN/3AJujvTnWjirekN6kRMcyB8LqU9wbFz4Xuha4I2RqZWQjq7onTvsiOLcG5rkd32U41442SurKhrD7QLtwHiuq4twIEDxCNpE8PAIyUFVj9qVGzlaDH8jvigo9Im5e005t4BGqsqpaZafGyZ/YqXsMH9I+KCIzbrC2coLuAPzQYfb4/NTI7jN1NfsukTJbc+7uQ+iaO5g+BQN+nGA2v99yssFi2vuCono6kBamBO/VO0sFS9kT3lBOqVROqAYpvHzEfFMtpCdEOKoB0bu4oJXWiIkJadcC0hVNbZgMwXDucZKdwuDIbDXHxNh4BBb0Lhc1uqoPRdYGzwO4Qnhhqw1e0T+aJP6ILVtjvgoog6aqB+09W0Cq8E7jEKayqHAEGxQK9sXE8+aVpBuJS0z3ohYwgEmb6FdM966oTqPFCXyLFSjidxseKB44xyKXrJsdVxMWKimXc/AhGJ3yecKJXe9sloBHAz8kNPHkCS031ABI+CCY8dxULGjs6zf5KQ3ENd6sT3KLjXiItMqzqGKaI9yRjJ8ENY3Ala+ukKITgEJrNG4pWzuWWj8ykj+ZdfkkIkXRBtkhdJm4+CFjOBKCHDiboH60gSCNR8U2554THJGXcvcjA3BFMl53yE6wnghrd3ijYeCBS7guY/ilZ3ShrskRcdyA2ORF90IYBuQubfQqDnkAIqBnvCaqCQRJCeoiBoqh2m4zdOPEjUpkRKcc61oVQuUGxhLSEW+SBsGEL6ehlBIfrIRuuE0O8ImGUCioYUerULd1k5VEXmyGJUVxfOlj3Is4IgqMTBiUtVh1CLgxa25E1saeSbZCVj4MHVQESDcG6g42mImO1+qk1WkXATWLfNM+HxCs6iGCuaYXLl2yMFNQoQVy5TIulNQouvP2Eq5MhoDUKU13cVy5XIa4Vz9hL15XLlMhtJ15ghL+0OiFy5PMNrhiHLhiXcvJKuTIaQ4l3LyXftLuPuSrkyGkOJdxXftLuK5cmQ1wxTuPuXOxbjw8guXJkNIzEuGh9yU4t3H3JVyZAgxj+KX9sfx9wXLkyGkdi3HU+4IG1iLSuXJkNK6sTvRNxDuPuXLkyG137Q7ihfXcdSuXJkNohiXj8ybfVJ1K5crkNf/Z" style="width: 209px; height: 161px; margin-left: -10px; margin-right: -11px; margin-top: 0px;"><div class="_aOd rg_ilm"><div class="rg_ilmbg"><span class="rg_ilmn"> 7290 × 5614 - commons.wikimedia.org </span></div></div>
https://upload.wikimedia.org/wikipedia/commons/a/ab/Frank_G._Carpenter,_Salvaging_scraps_on_the_streets_of_Paris.jpg
The easiest option would be the second thing you mentioned. You can extract the href value, then run it through urllib's unquote function. When you are on the image results page:
import urllib
images = driver.find_elements_by_class_name('rg_l')
for image in images:
href = image.get_attribute('href')
if '?imgurl=' in href: # Do this because often times the last result will not be an actual image
image_url_raw = href.split('?imgurl=')[1].split('&imgrefurl=')[0]
image_url = urllib.unquote(urllib.unquote(image_url_raw))
If you are on Python3, you need to use urllib.parse.unquote(urllib.parse.unquote(image_url_raw)) instead
I'm trying to connect to a school url and automate the process with selenium. Originally I tried using splinter, but ran into similar problems. I can't seem to be able to interact with the username and password fields. I realized a little ways in that it is an iframe that I need to interact with. Currently I have:
import time
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
driver = webdriver.Firefox()
driver.get("https://my.oregonstate.edu/webapps/login/")
driver.switch_to.frame('Content') #I tried contentFrame and content as well
loginid = driver.find_elements_by_id('user_id')
loginid.send_keys("***")
passwd = driver.find_elements_by_id('password')
passwd.send_keys("***")
sub = driver.find_elements_by_id('login')
sub.click()
time.sleep(5)
driver.close()
Here is the HTML that I am trying to interact with:
The Website: https://my.oregonstate.edu/webapps/portal/frameset.jsp
The iframe:
<iframe id="contentFrame" style="height: 593px;" name="content" title="Content" src="/webapps/portal/execute/tabs/tabAction?tab_tab_group_id=_1_1" frameborder="0"></iframe>
The forms:
Username:
<input name="user_id" id="user_id" size="25" maxlength="50" type="text">
Password:
<input size="25" name="password" id="password" autocomplete="off" type="password">
It seems that selenium can locate the elements just find, but I am unable to input any information into these fields, I got the error 'List object has no attribute'. When I realized it was the iframe I tried to navigate into that but it says 'Unable to locate frame: Content'. Is there another iframe that I am missing? Or something obvious? This is my first time here so sorry if I messed something up with the code linking.
Thanks for the help.
driver.switch_to.frame() takes frame's id or name, where your frame have id = contentFrame and name = content. (The reason they didn't work is probably because of a different issue, read through please)
First, please try use either one of them, not Content (which has upper case C).
Once you have fixed the issue above, there will be another error in your code.
loginid = driver.find_elements_by_id('user_id')
loginid.send_keys("***")
driver.find_elements_by_id finds all matching elements, which is a list. So you can't use send_keys. Please use driver.find_element_by_id('user_id').
Here is the code I tested working.
from selenium import webdriver
driver = webdriver.Firefox()
driver.get("https://my.oregonstate.edu/webapps/login/")
driver.switch_to.frame('content') # all lower case to match your actual frame name
loginid = driver.find_element_by_id('user_id')
loginid.send_keys("***")
passwd = driver.find_element_by_id('password')
passwd.send_keys("***")
Regarding issue in your following comments
from selenium import webdriver
driver = webdriver.Firefox()
driver.get("https://my.oregonstate.edu/webapps/login/?action=relogin")
loginid = driver.find_element_by_id('user_id')
loginid.send_keys("***")
passwd = driver.find_element_by_id('password')
passwd.send_keys("***")
driver.find_element_by_css_selector('.submit.button-1').click()