We have now also well prepared a demo that you should run the brokers all on your own activity on an arbitrary webpage. An illustration is demonstrated higher than where by the agent is tasked to locate the best Thai cafe in Pittsburgh. creating on our ecosystem, we launch a list of benchmark tasks focusing on assessing the useful correctness of p

To facilitate Assessment and evals, we have also produced the trajectories with the GPT-4V + SoM agent on the full set of 910 VWA duties right here. It includes .html files that report the agent's observations and output at Each individual action on the trajectory. We now have also ready a demo so that you can run the brokers on your personal acti