Skip to content

add continuous room type detection based on OpenAI VLM#738

Open
ShaohongZ wants to merge 7 commits intomainfrom
room_detection
Open

add continuous room type detection based on OpenAI VLM#738
ShaohongZ wants to merge 7 commits intomainfrom
room_detection

Conversation

@ShaohongZ
Copy link
Contributor

Overview

Added continuous room type detection and logging using OpenAI VLM

Changes

Included an update to the OpenAI VLM input for room type detection, and a new background process with a provider to publish the room type to the SLAM map location API

@ShaohongZ ShaohongZ requested review from a team as code owners November 19, 2025 16:48
@github-actions github-actions bot added robotics Robotics code changes python Python code labels Nov 19, 2025
@codecov
Copy link

codecov bot commented Feb 9, 2026

❌ 1 Tests Failed:

Tests completed Failed Passed Skipped
1 1 0 0
View the top 1 failed test(s) by shortest run time
tests/inputs/base/test_inputs_plugins.py::tests.inputs.base.test_inputs_plugins
Stack Traces | 0s run time
.../inputs/base/test_inputs_plugins.py:35: in <module>
    @pytest.mark.parametrize("input_class", get_all_inputs_classes())
.../inputs/base/test_inputs_plugins.py:20: in get_all_inputs_classes
    module = importlib.import_module(f"inputs.plugins.{plugin}")
.../hostedtoolcache/Python/3.10.19........./x64/lib/python3.10/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
<frozen importlib._bootstrap>:1050: in _gcd_import
    ???
<frozen importlib._bootstrap>:1027: in _find_and_load
    ???
<frozen importlib._bootstrap>:1006: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:688: in _load_unlocked
    ???
<frozen importlib._bootstrap_external>:883: in exec_module
    ???
<frozen importlib._bootstrap>:241: in _call_with_frames_removed
    ???
.../inputs/plugins/vlm_openai_rtsp_room_detection.py:34: in <module>
    class VLMOpenAIRTSPROOM(FuserInput[str]):
.../hostedtoolcache/Python/3.10.19........./x64/lib/python3.10/typing.py:312: in inner
    return func(*args, **kwds)
.../hostedtoolcache/Python/3.10.19........./x64/lib/python3.10/typing.py:1345: in __class_getitem__
    _check_generic(cls, params, len(cls.__parameters__))
.venv/lib/python3.10/site-packages/typing_extensions.py:3100: in _check_generic
    raise TypeError(f"Too {'many' if alen > elen else 'few'} {things}"
E   TypeError: Too few arguments for <class 'inputs.base.loop.FuserInput'>; actual 1, expected at least 2

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

python Python code robotics Robotics code changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants