[ViX_Misc] EPG corrupt - can't work out why it keeps happening

[Huevos]

Automatic refresh (Read file in from hard drive) in the EPG settings. I "had" it set to that as I mistakenly thought I was doing the right thing. Both settings are now "off" per the image in post #35

Those files are for use on client receivers. So you are correct to disable them.

 

[Huevos]

1) Turn on debug logs. This will show if the box crashes or does not behave properly.
2) Now disable CrossEPG and remove the plugin altogether from the receiver.
3) Disable Freesat EPG (you can re-enable this later once it works properly).
4) Set up EPG refresh to download from IEPG data channel (do a manual run).
5) Set up EPGImporter to download any packages not captured in step 4 (do not duplicate data sources. So do not download any UK satellite data using EPGImporter. Do a manual run).
6) Once you have the EPG fully populated restart enigma (this forces a save to epg.dat).
7) Wait and see what happens.

 

[smipx]

Maybe for that particular one the descriptions can be added to to state that. That would stop accidental enablement for someone else perhaps.

e.g.:

 

[smipx]

Mine is working just fine now Huevos so I will leave it as-is mate.

 

[smipx]

What I have noticed for CrossEPG (since setting it to run every hour when in standby) is that my EPG is nicely up-to-date most of the time now

I have found a bug in CrossEPG though. Every time it runs I get:

< 45649.002> [eDVBLocalTimerHandler] no transponder tuned... or no TDT/TOT avail .. try to use RTC
< 45649.002> [eDVBLocalTimerHandler] getRTC returned time=0. RTC problem?
< 45752.439> [Task] job Components.Task.Job name=SoftcamCheck #tasks=1 completed with [] in None
< 46069.028> [CrossEPG_Auto] onTimer occured at Thu 16 Apr 2020 11:20:00 BST
< 46069.030> [CrossEPG_Auto] Running CrossEPG Thu 16 Apr 2020 11:20:00 BST
< 46069.031> [CrossEPG_Auto] Time set to Thu 16 Apr 2020 12:20:00 BST (now=Thu 16 Apr 2020 11:20:00 BST)
< 46069.131> [Errno 2] No such file or directory: '/media/hdd//crossepg.log'
< 46069.131> [CrossEPG_Auto] providers selected for download:
< 46069.131> [CrossEPG_Auto] skyuk_astra2_28.2
< 46069.235> [CrossEPG_Wrapper] executing /usr/crossepg/crossepg_downloader -r -d /media/hdd/crossepg

In a part of the crossEPG code it has an extra slash!! Oddly enough though it must be only on one place as the crossEPG.log file does get written to every hour with all of its doings.

i.e. like this:
16/04/2020 11:20:00 SIFTeam CrossEPG Downloader 0.8.6+gitrAUTOINC+80b61723e7 (c) 2009-2014 Sandro Cavazzoni (https://github.com/oe-alliance/e2openplugin-CrossEPG)
16/04/2020 11:20:02 This software is distributed under the terms of the GNU Lesser General Public License v2.1
16/04/2020 11:20:03 Interactive: OPEN cmd received
16/04/2020 11:20:03 EPGDB opened (root=/media/hdd/crossepg)
16/04/2020 11:20:03 Clearing old aliases...
16/04/2020 11:20:03 Loading 'aliases.conf'...
16/04/2020 11:20:03 Loaded 1 aliases
16/04/2020 11:20:03 Adding new aliases...
16/04/2020 11:20:03 Completed
16/04/2020 11:20:03 Interactive: OK action sent
16/04/2020 11:20:03 Interactive: DEMUXER cmd received
16/04/2020 11:20:03 Interactive: OK action sent
16/04/2020 11:20:03 Interactive: FRONTEND cmd received
16/04/2020 11:20:03 Interactive: OK action sent
16/04/2020 11:20:03 Interactive: DOWNLOAD cmd received
16/04/2020 11:20:03 Started OpenTV events download
16/04/2020 11:20:03 Reading dictionary '/usr/crossepg/providers/skyuk_astra2_28.2.dict' ...
16/04/2020 11:20:03 Completed. Read 512 values
16/04/2020 11:20:03 Reading channels...
16/04/2020 11:20:03 Reading pid 0x11...
16/04/2020 11:20:13 Done
16/04/2020 11:20:13 Read 882 channels
16/04/2020 11:20:13 Reading titles...
16/04/2020 11:20:13 Reading pid 0x30...
16/04/2020 11:20:21 Done
16/04/2020 11:20:21 Reading pid 0x31...
16/04/2020 11:20:28 Done
16/04/2020 11:20:28 Reading pid 0x32...
16/04/2020 11:20:32 Done
16/04/2020 11:20:32 Reading pid 0x33...
16/04/2020 11:20:38 Done
16/04/2020 11:20:38 Reading pid 0x34...
16/04/2020 11:20:45 Done
16/04/2020 11:20:45 Reading pid 0x35...
16/04/2020 11:20:52 Done
16/04/2020 11:20:52 Reading pid 0x36...
16/04/2020 11:20:59 Done
16/04/2020 11:20:59 Reading pid 0x37...
16/04/2020 11:21:06 Done
16/04/2020 11:21:06 Read 4.29 MB
16/04/2020 11:21:06 Parsing titles...
16/04/2020 11:21:07 Titles parsed
16/04/2020 11:21:07 Reading summaries...
16/04/2020 11:21:07 Reading pid 0x40...
16/04/2020 11:21:19 Done
16/04/2020 11:21:19 Reading pid 0x41...
16/04/2020 11:21:31 Done
16/04/2020 11:21:31 Reading pid 0x42...
16/04/2020 11:21:38 Done
16/04/2020 11:21:38 Reading pid 0x43...
16/04/2020 11:21:47 Done
16/04/2020 11:21:47 Reading pid 0x44...
16/04/2020 11:21:59 Done
16/04/2020 11:21:59 Reading pid 0x45...
16/04/2020 11:22:10 Done
16/04/2020 11:22:10 Reading pid 0x46...
16/04/2020 11:22:22 Done
16/04/2020 11:22:22 Reading pid 0x47...
16/04/2020 11:22:33 Done
16/04/2020 11:22:33 Read 16.20 MB
16/04/2020 11:22:33 Parsing summaries...
16/04/2020 11:22:37 Summaries parsed
16/04/2020 11:22:37 Ended OpenTV events download
16/04/2020 11:22:37 Interactive: SAVE cmd received
16/04/2020 11:22:37 Interactive: CLOSE cmd received
16/04/2020 11:22:37 EPGDB closed
16/04/2020 11:22:37 Interactive: OK action sent
16/04/2020 11:22:37 Interactive: QUIT cmd received

 

[ccs]

The extra slash won't make any difference.

 

[smipx]

Fair enough

 

[Joe_90]

The extra slash won't make any difference.

There's something not quite right about it though - CrossEPG files (database and logs) should be in /media/hdd/crossepg/ not in /media/hdd//
I'll have a look through my debug and CrossEPG logs.

@smipx - what @Huevos says makes most sense - don't have Freesat and OpenTV EPG readers enabled at the same time. EPGRefresh should work with the iEPG transponder and gather the data correctly and you could run it several times per day providing you have a free tuner. I think the clock warning you're seeing in the log is because you have the receiver in standby, perhaps? My receiver is always in one of two modes - on and in use or in deep standby. We tend to use the box in the evenings and mostly watch recorded stuff (so we skip the ads!) and then put it in deep standby at bedtime.

EDIT - checked logs

A snip of the debug log for my run of CrossEPG this morning:

<   490.040> [CrossEPG_Auto] onTimer occured at Thu 16 Apr 2020 04:35:00 IST
<   490.045> [CrossEPG_Auto] Running CrossEPG Thu 16 Apr 2020 04:35:00 IST
<   490.050> [CrossEPG_Auto] Time set to Fri 17 Apr 2020 04:35:00 IST (now=Thu 16 Apr 2020 04:35:00 IST)
<   490.150> [Errno 2] [B]No such file or directory: '/media/hdd//crossepg.log'[/B]
<   490.150> [CrossEPG_Auto] providers selected for download:
<   490.150> [CrossEPG_Auto] skyuk_astra2_28.2

I suspect that the code may be trying to trim the log, but is looking in the wrong place. The reason is that my cross log (located in /media/hdd/crossepg/crossepg.log) is over 400KB in size and contains every run of Cross since 2018. I only schedule Cross to run twice a week in any case.

I'll raise a bug report to the devs so they can have a look.

 

[smipx]

There's something not quite right about it though - CrossEPG files (database and logs) should be in /media/hdd/crossepg/ not in /media/hdd//
I'll have a look through my debug and CrossEPG logs.

@smipx - what @Huevos says makes most sense - don't have Freesat and OpenTV EPG readers enabled at the same time. EPGRefresh should work with the iEPG transponder and gather the data correctly and you could run it several times per day providing you have a free tuner. I think the clock warning you're seeing in the log is because you have the receiver in standby, perhaps? My receiver is always in one of two modes - on and in use or in deep standby. We tend to use the box in the evenings and mostly watch recorded stuff (so we skip the ads!) and then put it in deep standby at bedtime.

EDIT - checked logs

A snip of the debug log for my run of CrossEPG this morning:

<   490.040> [CrossEPG_Auto] onTimer occured at Thu 16 Apr 2020 04:35:00 IST
<   490.045> [CrossEPG_Auto] Running CrossEPG Thu 16 Apr 2020 04:35:00 IST
<   490.050> [CrossEPG_Auto] Time set to Fri 17 Apr 2020 04:35:00 IST (now=Thu 16 Apr 2020 04:35:00 IST)
<   490.150> [Errno 2] [B]No such file or directory: '/media/hdd//crossepg.log'[/B]
<   490.150> [CrossEPG_Auto] providers selected for download:
<   490.150> [CrossEPG_Auto] skyuk_astra2_28.2

I suspect that the code may be trying to trim the log, but is looking in the wrong place. The reason is that my cross log (located in /media/hdd/crossepg/crossepg.log) is over 400KB in size and contains every run of Cross since 2018. I only schedule Cross to run twice a week in any case.

I'll raise a bug report to the devs so they can have a look.

Nice one - this should be put to bed

There are some other bugs/features raised in this thread though (my post #35 lists 2 other candidates for fixing) that the DEV's may want to address in the fullness of time.