We Keep Coding

Message: 'geckodriver' executable needs to be in PATH - GoogleCloud

I just created a discord bot and its job is that scraping some data from web and do that help with selenium. On my own computer it works perfectly and i decided to upload it on any cloud server and make it online 7/24. So i found GoogleCloud for free and created an ubuntu VM. I installed required modules and just moved chromedriver to the path that test.py is located. When i type python test.py and execute, it works fine untill any function that has driver.chrome() statement works. Thanks for commentsubuntu terminal

Specify The executable_path Parameter Value When Initialize Firefox like belwo.
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.chrome.service import Service
from webdriver_manager.chrome import ChromeDriverManager
options = Options()
options.add_argument("start-maximized")
driver = webdriver.Chrome(service=Service(ChromeDriverManager().install()), options=options)
driver.get("https://www.google.com")

Selenium with brave a chromium based browser(Version 1.33.106 Chromium: 96.0.4664.110 (Official Build) (64-bit)

I'm a beginner level python programmer,
I am currently working on a browser automater using selenium,
but currently i'am using brave version 96.0.4664.45
and my chrome driver is'nt working properly, whereas geckodriver is working fine with firfox
error here---> Errors with selenium library in python path and all correct with my side
Pls help me as soon as possible

To initiate a brave browsing context you need to:
Use the binary_location attribute to point to the brave binary location.
Use the chromedriver executable to initiate the brave browser.
Code block:
from selenium import webdriver
from selenium.webdriver.chrome.service import Service
option = webdriver.ChromeOptions()
option.binary_location = r'C:\Program Files (x86)\BraveSoftware\Brave-Browser\Application\brave.exe'
driverService = Service('C:/Users/.../chromedriver.exe')
driver = webdriver.Chrome(service=driverService, options=option)
driver.get("https://www.google.com")
References
You can find a couple of relevant detailed discussions in:
How to use Brave web browser with python, selenium and chromedriver?
Use Selenium with Brave Browser pass service object written in python
How to initiate Brave browser using Selenium and Python on Windows

I suggest to try webdriver_manager
https://github.com/SergeyPirogov/webdriver_manager.
It helps to setup path to chromedriver.
For Chrome:
from selenium import webdriver
from webdriver_manager.chrome import ChromeDriverManager
driver = webdriver.Chrome(ChromeDriverManager().install())
For Chromium:
from selenium import webdriver
from webdriver_manager.chrome import ChromeDriverManager
from webdriver_manager.utils import ChromeType
driver = webdriver.Chrome(ChromeDriverManager(chrome_type=ChromeType.CHROMIUM).install())
I suppose some of this will work for Brave.
Also, take a look at this example:
https://gist.github.com/passivebot/91d726bafc1f08eb475dd8384a3f21db

page loading takes forever on selenium chrome webdriver ubuntu?

I am trying to run selenium based scraping service on ubuntu but chrome driver does not load page. It is stuck on loading, however when I open new tab manually, it loads the website? I cannot figure out the exact issue because it does not throw any error.
Following is the output I get,
Following is the code I am running.
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.chrome.service import Service
ch_ser=Service(executable_path='/usr/bin/chromedriver')
chrome_options = Options()
chrome_options.add_argument('--no-sandbox')
##chrome_options.add_argument('--headless')
chrome_options.add_argument('--disable-extensions')
driver = webdriver.Chrome(service=ch_ser,options=chrome_options)
#print("Opening page."
driver.get('https://google.com')

I had the same problem on my Raspberry pi 4 with XFCE (xubuntu 64bit) linux.
The problem is probably in Chromedriver.
I solved this problem by replacing Chromium with Firefox.
If you are on Linux too, try to install geckodriver for Firefox and use it instead of Chrome.
sudo apt install firefox-geckodriver

Python Selenium Detach Option Not Working

I want to write a Python script using Selenium and Chrome where Selenium won't close the Chrome browser when the script finishes. From doing a bunch of googling, it looks like the standard solution is to use the detach option. But when I run the following script:
import selenium
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
chrome_options = Options()
chrome_options.add_experimental_option("detach", True)
driver = webdriver.Chrome(options=chrome_options)
driver.get("https://www.google.com/")
It opens up Chrome, goes to Google's homepage, and then closes the browser. It's not throwing any errors.
Any idea why it's not working? I'm using the latest version of Google Chrome on Windows 10, and I've got the latest version of the selenium module installed. I couldn't find anything online that said the experimental detach option no longer existed. And I double checked the API, and it looks like it's the right syntax.

I discovered another way to go: start Chrome in remote debugging mode, then connect to it. That way, not only does the browser stay open, but you can also use your existing Chrome profile so you can take advantage of any sites your cookies allow you to access without having to log in every time you run the script.
Here's what you need to do if you're on Windows 10:
Start Google Chrome up remotely, pointed towards your existing user profile and the port you want to use:
cd "C:\Program Files (x86)\Google\Chrome\Application"
chrome.exe -remote-debugging-port=9014 --user-data-dir="%LOCALAPPDATA%\Google\Chrome\User Data"
In your python script, connect to the local port that this version of Chrome is running on:
import selenium
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
chrome_options = Options()
chrome_options.add_experimental_option("debuggerAddress", "localhost:9014")
driver = webdriver.Chrome(options=chrome_options)
driver.get("https://github.com/")

This code worked perfectly for me using : selenium-wire , hope it works for you
from seleniumwire import webdriver
from webdriver_manager.chrome import ChromeDriverManager
from selenium.webdriver.chrome.options import Options
chrome_options = Options()
chrome_options.add_experimental_option("detach", True)
driver = webdriver.Chrome(ChromeDriverManager().install(),options=chrome_options)
driver.get("https://www.google.com/")

Is there a Windows equivalent to PyVirtualDisplay

I have written a web scraper for a mate to save him time at work. It is written in Python, using Selenium and opening a Firefox browser.
I have written this code myself on a Linux machine I use PyVirtualDisplay so Firefox doesn't actually open and disturb my work.
How can I make it run within a virtual display on a Windows PC?

The reason you can not run PyVirtualDisplay on Windows is that PyVirtualDisplay uses Xvfb as it's display and Xvfb is a headless display server for the X Window System, Windows does not use the X Window System.
not recommended
So... what you can do if you insist on working with PyVirtualDisplay is to change the Display(visible=True) Or you can set the backend as is shown in the API here.
My recommendation
Don't use PyVirtualDisplay you can use any webdriver such as Chrome driver and just add ChromeOptions with --headless.
Or in your case you use firefox so it would look something like:
from selenium import webdriver
from selenium.webdriver.firefox.options import Options
options = Options()
options.add_argument("--headless")
driver = webdriver.Firefox(firefox_options=options, executable_path="C:\\Utility\\BrowserDrivers\\geckodriver.exe")
print("Firefox Headless Browser Invoked")
driver.get('http://google.com/')
driver.quit()
For more updated info just have a look here.
Hope this helps you!