[FEATURE]: Browser Automation using AI

[surapuramakhil]

Feature summary

As of now AI is used for generating answers to the questions

Feature description

proposal:- AI to use as browser agent - viewing and acting directly on UI, performing job Application.

Motivation

No response

Alternatives considered

No response

Additional context

No response

[cjbbb]

After using this, can we apply for jobs on other job websites?

[surapuramakhil]

After using this, can we apply for jobs on other job websites?

cache is it's tough to implement 😅
@49Simon kindly comment on possibility - existing library support? I guess we send feed to AI (UI of browser)

[49Simon]

This would be something similar to Claude's Computer Use. Its early in development phase but by using tool use and vision models, it iteratively sends screenshots back to the model until the task is complete.

[feder-cr]

@surapuramakhil @cjbbb in this moment this tools not work correctly, also https://github.com/sentient-engineering/jobber isn't good, but if you want you can try!

[cjbbb]

@surapuramakhil @cjbbb in this moment this tools not work correctly, also https://github.com/sentient-engineering/jobber isn't good, but if you want you can try!

I will check the link

[surapuramakhil]

Another tool/lib bowser pilot which does same thing - https://github.com/handrew/browserpilot, once matured we can start using in this project.

[jfelten]

I am interested in pitching in. I went through the AIHawk code and have some ideas on how to use the existing classes to make a flexible architecture that allows for other sites. By this, I mean extending the current job_manager and LinkedIn_easy_applier classes to work for other sire like Amazon. I am the one who brought up browserpilot and would want to see if I could make it work. I wanted to see if anyone else has proposed similar ideas.

[surapuramakhil]

would want to see if I could make it work.

Appreciate that - Assigned this to you.

I wanted to see if anyone else has proposed similar ideas.

that was me, #401 found that it was never reopened.

If you wish I can also assign 401 for you. @jfelten

[surapuramakhil]

another project - https://github.com/gregpr07/browser-use

[feder-cr]

@jfelten @sarob @cjbbb try also to contact/work with @gregpr07

[feder-cr]

@jfelten https://github.com/Skyvern-AI/skyvern

[surapuramakhil]

@jfelten https://github.com/Skyvern-AI/skyvern

This one seems to be quite mature.