incomplete

[mrbreil]

I can't download my source. I am very new to IPTV. can someone give me a hint.
URLs work in the browser and via wget.

debug
[2024-03-24T11:39:35Z DEBUG m3u_filter::utils] getting input text content working_dir: ./, url: http://source.com:8080 [2024-03-24T11:39:35Z DEBUG m3u_filter::utils] Request headers {} [2024-03-24T11:39:35Z DEBUG reqwest::connect] starting new connection: http://source.com:8080/ [2024-03-24T11:39:35Z DEBUG hyper::client::connect::dns] resolving host="source.com" [2024-03-24T11:39:35Z DEBUG hyper::client::connect::http] connecting to xx.xx.xx.xx:8080 [2024-03-24T11:39:35Z DEBUG hyper::client::connect::http] connected to xx.xx.xx.xx:8080 [2024-03-24T11:39:35Z DEBUG hyper::proto::h1::io] flushed 60 bytes [2024-03-24T11:39:35Z DEBUG hyper::proto::h1::io] parsed 10 headers [2024-03-24T11:39:35Z DEBUG hyper::proto::h1::conn] incoming body is chunked encoding [2024-03-24T11:39:35Z DEBUG hyper::proto::h1::decode] incoming chunked header: 0xC (12 bytes) [2024-03-24T11:39:35Z ERROR m3u_filter::utils] cant download input url: http://source.com:8080 => Request failed: 401 Unauthorized [2024-03-24T11:39:35Z INFO actix_web::middleware::logger] 192.168.180.10 "POST /api/v1/playlist HTTP/1.1" 400 47 "http://m3u:8901/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:123.0) Gecko/20100101 Firefox/123.0" 0.176922 [2024-03-24T11:39:35Z DEBUG hyper::proto::h1::conn] incoming body completed

source.yaml

`sources:

• inputs:
  • enabled: true
    type: xtream
    persist: playlist_1_
    headers:
    User-Agent: "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:21.0) Gecko/20100101 Firefox/21.0"
    Accept: application/json
    Accept-Encoding: gzip
    epg_url: http://source.com:8080/xmltv.php?username=xxx&password=xxx
    url: 'http://source.com:8080'
    username: xxx
    password: xxx
    options: {xtream_info_cache: true }
    targets:
  • name: pl1
    output:
    • type: m3u
      filename: playlist_1.m3u
      filter: '!ALL_CHAN!'
      options: { ignore_logo: true }
      rename:
    • { field: group, new_name: 1. DE$1, pattern: ^DE(.*) }
      sort:
      groups:
      order: asc
  • name: plxtream
    output:
    • type: xtream
      filename:
      filter: '!ALL_CHAN!'
      options: { ignore_logo: true }
      `

[euzu]

@mrbreil can you remove the headers part from the input.
And have you space after username or password?

[mrbreil]

hallo thank you for your help!!!!
i dont have a space after username or password.
if i remove the headers part complete, i cant login.

Request failed: 401 Unauthorized

Sorry for my bad english

[euzu]

You wrote in the browser the url works. But how could you test xtream api access? How did you create your player_api url ?
Dou you have a xtream acccount or a m3u access?
If it is only m3u, your config is wrong

[mrbreil]

in browser i use player_api.php

{ "user_info": { "username": "xxxx", "password": "xxxx", "message": "xxx", "auth": 1, "status": "Active", "exp_date": "xxx", "is_trial": "0", "active_cons": "0", "created_at": "xxxxx", "max_connections": "1", "allowed_output_formats": [ "m3u8", "ts" ] }, "server_info": { "url": "xxxx", "port": "8080", "https_port": "", "server_protocol": "http", "rtmp_port": "8880", "timezone": "Europe\/Paris", "timestamp_now": 1711282902, "time_now": "2024-03-24 13:21:42", "process": true } }

does "allowed_output_formats": [ "m3u8", "ts" ] mean i dont have xtream account???

but if i use your programm with m3u the new output m3u playlist dont change the url. i can not use m3u-filter as proxy.

[euzu]

@mrbreil yes you have a xtream account, i dont know why it does not work, normally if everything is configured right, it should work.

[mrbreil]

What can I do to troubleshoot.

[euzu]

@mrbreil first make your config as simple as possible, only necessary fields, one input one output.

Then run m3u-filter with debug output.

Did you wrote the config on windows?
I am not sure but line endings could be a problem.

[mrbreil]

line endings is correct lf
i test with mitmproxy.
m3u-filter call the plain domain, witouth path, password or user.
Is this correct?

Unfortunately I can't find any documentation about the xtream api. What should come back?

[euzu]

@mrbreil no, the url is generated by m3u-filter. The request is made with a xtream api url.

[mrbreil]

unfortunately no, according to mitmproxy, m3u-filter direct calls "http://source.com:8080" without url parameters.
which is the first url that would call m3u-filter.

[euzu]

@mrbreil here a working example

sources:
- inputs:
  - name: simple_xt
    type: xtream
    username: xxxxx
    password: xxxxx
    url: http://xxx.xxx.com
    epg_url: http://xxx.xxx.com/xmltv.php?use
rname=xxxx&password=xxxx
  targets:
  - name: simplext
    output:
      - type: xtream
    filter: "!SIMPLE_CHAN_ME_XT!"
    options: {ignore_logo: true, xtream_skip_live_dire
ct_source: true, xtream_skip_video_direct_source: true
}

[mrbreil]

yes with the command
wget -O content.txt --header="Accept: application/json" --user-agent="Apple TV; tvOS 13.3.1" "http://source.com:8080/player_api.php?username=user&password=password&action=get_live_categories"
i get content and jsonlint says it is a valid json

[euzu]

how do you run m3u-filter, has m3u-filter internet access ? If yes then i dont know what the problem is. It should work as expected.

Source is empty means, m3u-filter did not receive data from request.

[mrbreil]

yes it has internet access!
i test the wget command on the same machine.
Maybe it's because of the special characters in the return?
the json contains for example \u2726
=get_live_categories => error decoding response body: expected value at line 1 column 1

[euzu]

i dont think that the content is the problem.
If you can debug the application, then you can look at the download_json_content method inside utıls.rs

[mrbreil]

So I tried my luck, but I'm not a programmer. After a lot of reading I managed to debug the program in vscode. But I don't know where to set a breakpoint in the download_json_content function to find anything useful.
I was able to find a problem in debug mode when I tested an m3u source instead of an xtream source.
I don't know if this is useful in any way. But couldn't reproduce this.
thread 'actix-rt|system:0|arbiter:3' panicked at src/repository/xtream_repository.rs:165:62: called Result::unwrap()on anErr value: ParseIntError { kind: Empty }
I have another idea: could it be that the api responds too slowly?
Can I set a timeout somewhere?

[euzu]

can you try to read and writr m3u playlist.
The error you got is comming from reading m3u playlist and writing xtream output.
The xtream output expects a number as id, i think your playlist has a string as an id for channels
This is a bug i have to fix this for m3u to xtream output.

If you provide me an anonymized m3u playlist where this error occurs, i can find the problem faster.

[mrbreil]

Excuse me please. I don't know what I should anonymize in this file?
it only contains data like:
[ { "category_id": "3 digits", "category_name": "\u2726 a channel name \u2726", "parent_id": 0 }, { "category_id": "other 3 digits", "category_name": "\u2726 7/24 other channelname\u2726", "parent_id": 0 } ]
Should I anonymize category_id and category_name? Sorry

[euzu]

ok it doesnt needs, but some of them can contain the url

[mrbreil]

content.json

[euzu]

it seems ok, there is no problem with the content.

The only thing you can do is to find out why m3u-filter does not get response from your provider.

You could use a proxy to log the traffic and look into the request and responses to understand the diference between curl and m3u-filter.

[euzu]

@mrbreil I have added some debug output, it is commited into the master branch.

[euzu]

@mrbreil any progress?

[mrbreil]

No, unfortunately not. I can't see any difference.

[euzu]

see issue gzip compressed content