Is it possible to include upsampler into the install and provide an upsampler that takes images one by one for a for-loop

[gintautas12358]

Hello devs,

Using your esim a lot in my project.
And though if it is possible to include upsampler into the install and provide an upsampler that takes images one by one for a for-loop.

I am developing a esim plugin for MuJoCo and that would help :D

[danielgehrig18]

I see, are you looking for an iterator which gives you the interpolated images for each new low framerate image?

…

On Tue, May 17, 2022 at 5:15 PM gintautas12358 ***@***.***> wrote: Hello devs, Using your esim a lot in my project. And though if it is possible to include upsampler into the install and provide an upsampler that takes images one by one for a for-loop. I am developing a esim plugin for MuJoCo and that would help :D — Reply to this email directly, view it on GitHub <#51>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AFBHKKA5O43352UODXL7MOTVKOZX3ANCNFSM5WFJKCCQ> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[gintautas12358]

exactly.

It would be handy to have.

[danielgehrig18]

Hi, I implemented a first version on https://github.com/uzh-rpg/rpg_vid2e/tree/upsampler_packager. Could you have a look? To test it you can use it as such

1. first install the package

pip install upsampling/

2. The upsampler can be used as such:

from upsampler import Upsampler

upsampler = Upsampler(I0, t0) # init the upsampler with an RGB (height, width, channel) image, and first timestamp

for I, t in zip(images, timestamps):
    # returns two lists, each with images up to and including I and t
    upsampled_images, upsampled_timestamps = upsampler.upsample_adaptively(I, t) 

[gintautas12358]

Looks great! Can't wait to try it!

So I encountered some issues

I got an import issue with
from upsampler import Upsampler

fixed:
Needed to add
from .upsampler import Upsampler
in the __init__.py in the installation directory

also running the upsampler I get the error:
/home/palinauskas/anaconda3/envs/vid2e/lib/python3.9/site-packages/upsampler/../../../pretrained_models/film_net/Style/saved_model/{saved_model.pbtxt|saved_model.pb}

so the pretrained_models are missing in the install directory

[gintautas12358]

Any new update on the matter?