Time |
Nick |
Message |
00:32 |
|
torgdor joined #minetest |
01:54 |
|
alkotob__ joined #minetest |
02:08 |
|
Freejack joined #minetest |
02:17 |
|
STHGOM joined #minetest |
02:17 |
|
STHGOM joined #minetest |
02:26 |
|
Void7 joined #minetest |
02:28 |
|
Tmanyo joined #minetest |
02:51 |
|
DMackey joined #minetest |
02:58 |
|
Sokomine joined #minetest |
03:13 |
|
imr joined #minetest |
03:21 |
|
halt_ joined #minetest |
03:24 |
|
halt_ joined #minetest |
03:28 |
|
Grandolf joined #minetest |
03:28 |
|
LazyJ joined #minetest |
03:31 |
|
Grandolf joined #minetest |
03:31 |
|
Grandolf joined #minetest |
03:33 |
|
Grandolf joined #minetest |
03:50 |
|
GunshipPenguin joined #minetest |
04:13 |
|
redblade joined #minetest |
04:21 |
|
swift110-phone joined #minetest |
04:26 |
|
swift110-phone joined #minetest |
04:26 |
MinetestBot |
[git] tenplus1 -> minetest/minetest_game: Bones: Search for nearby 'air' for fallback bones placement 0cbb516 https://git.io/viRal (2016-09-10T05:19:15+01:00) |
04:26 |
MinetestBot |
[git] sofar -> minetest/minetest_game: Xpanes: Convert to connected nodeboxes 54235f3 https://git.io/viRa8 (2016-09-10T05:18:02+01:00) |
04:30 |
nolsen |
What is the best way to run git pull on all the directories in /mods at once? |
04:33 |
nolsen |
#4513 |
04:33 |
nolsen |
er |
04:33 |
nolsen |
wrong channel |
05:05 |
|
Markow joined #minetest |
05:19 |
|
redblade joined #minetest |
05:23 |
|
davisonio joined #minetest |
05:25 |
|
YvesLevier joined #minetest |
05:25 |
|
hax404 joined #minetest |
05:25 |
|
yusf[m] joined #minetest |
05:25 |
|
thePalindrome joined #minetest |
05:25 |
|
froike joined #minetest |
05:25 |
|
ssieb joined #minetest |
05:26 |
|
WillMoogle joined #minetest |
05:27 |
|
lumidify joined #minetest |
05:27 |
|
ssieb joined #minetest |
06:17 |
|
CWz joined #minetest |
06:33 |
agaran |
Hijiri: ah, so I mistaken from which mod it comes from.. |
06:43 |
Hijiri |
maybe or maybe not, I think homedecor has some similar items which may get replaced when technic is available |
06:45 |
|
Krock joined #minetest |
06:45 |
|
Krock joined #minetest |
06:56 |
|
lumidify joined #minetest |
06:59 |
|
jojoa1997 joined #minetest |
07:14 |
Chinchou |
Hijiri, the "Control Logic Unit" is specifically Technic, yes. Homedecor has a crafting ingredient that is similar(Integrated Circuit, I think), but they're still two different items. |
07:17 |
Chinchou |
Only the CLU provides the upgrade for machines, as far as I'm aware. I could be mistaken on that... |
07:38 |
|
basxto joined #minetest |
07:54 |
|
namach joined #minetest |
07:57 |
|
Krock joined #minetest |
08:04 |
|
greeter joined #minetest |
08:04 |
|
freelikegnu joined #minetest |
08:04 |
|
kaen joined #minetest |
08:04 |
|
Sockbat joined #minetest |
08:04 |
|
alt91265 joined #minetest |
08:04 |
|
aix joined #minetest |
08:04 |
|
superfly joined #minetest |
08:04 |
|
ruskie joined #minetest |
08:04 |
|
nnnn20430 joined #minetest |
08:04 |
|
bulldozer joined #minetest |
08:04 |
|
iamtew joined #minetest |
08:04 |
|
Preuk_away joined #minetest |
08:04 |
|
Tiktalik joined #minetest |
08:04 |
|
Tesseract joined #minetest |
08:04 |
|
Kray joined #minetest |
08:05 |
|
Yst joined #minetest |
08:05 |
|
alkotob__ joined #minetest |
08:05 |
|
AnotherBrick joined #minetest |
08:05 |
|
Taz|ZzZ joined #minetest |
08:05 |
|
Elench joined #minetest |
08:05 |
|
abruanese joined #minetest |
08:05 |
|
gentoobro joined #minetest |
08:14 |
|
WillMoogle joined #minetest |
08:34 |
|
Szkodnix joined #minetest |
08:50 |
|
Trustable joined #minetest |
09:08 |
|
SylvieLorxu joined #minetest |
09:08 |
|
Darcidride joined #minetest |
09:15 |
|
sonicpp joined #minetest |
09:29 |
|
PjotrOrial joined #minetest |
09:29 |
|
PjotrOrial joined #minetest |
09:34 |
|
FirePowi joined #minetest |
09:36 |
|
tpe joined #minetest |
09:57 |
|
Darcidride joined #minetest |
10:02 |
|
red-001 joined #minetest |
10:07 |
|
IhrFussel joined #minetest |
10:10 |
IhrFussel |
agaran, I don't know what I can do to stop the lag...I have the feeling it's caused by many different larger mapblocks that contain animations/entities/sounds or just dozens of blocks... there are A LOT of mapblocks with sizes >10k and if I'd delete all those many cities and bigger areas would likely get destroyed (partly) |
10:19 |
IhrFussel |
Is my assumption correct that lava will not burn any materials anymore when I remove the "ignite" group from the node def? |
10:20 |
IhrFussel |
igniter* |
10:23 |
sfan5 |
yes that should be the case |
10:23 |
sfan5 |
my suggestion still stands: put those map blocks into my script and find out why they are so big |
10:25 |
IhrFussel |
sfan5, I see a pos on the forums that states the behavior needs to be fixed from Jan 10 so it probably doesn't work like that (regarding groups) ... but there are so many blocks with that size =/ |
10:25 |
IhrFussel |
post* |
10:37 |
|
xunto joined #minetest |
10:49 |
IhrFussel |
sfan5, could you give me the link to the code again? |
10:49 |
sfan5 |
https://gist.github.com/sfan5/52917a0e1338bcda2176edbc416dae60 |
10:54 |
IhrFussel |
sfan5, thanks =) Is it possible to give the script parameters when calling? Like inside a while read line loop |
10:55 |
sfan5 |
it can take an argument on the command line |
10:55 |
sfan5 |
which is a .txt file with sqlite's output |
10:56 |
IhrFussel |
So all the positions inside a .txt file one per line? |
10:57 |
sfan5 |
no |
10:57 |
IhrFussel |
Or you mean like while read line; do echo $line > tempfile.txt; run script with tempfile.txt as argument; done ? |
10:58 |
sfan5 |
use SELECT LENGTH(data), pos WHERE LENGTH(data) > 10000 ORDER BY LENGTH(data) DESC; to find out the pos of large mapblocks |
10:58 |
sfan5 |
then you can use SELECT HEX(data) FROM block WHERE pos = -123445; to get the hex data of a single block |
10:58 |
sfan5 |
put that hex data into a .txt and file and then call the script with that |
10:59 |
sfan5 |
ok the first one is "SELECT pos, LENGTH(data) FROM blocks WHERE LENGTH(data) > 10000 ORDER BY LENGTH(data) DESC;" actually |
11:00 |
sfan5 |
also in the second it's "FROM blocks" not "FROM block" |
11:00 |
|
everamzah joined #minetest |
11:01 |
IhrFussel |
I know how to execute the hex data from DB but I want to automate the stuff inside a while read line loop..so can I then echo each hex line in a tempfile and call your script with it as argeument? |
11:01 |
sfan5 |
yes you can do that |
11:02 |
IhrFussel |
And can i append the script output with a redirect to another file that collects all data? |
11:04 |
IhrFussel |
Like python mapblock-parse.py > collectingdata.txt ? |
11:04 |
IhrFussel |
>>* |
11:04 |
sfan5 |
why would that not work? |
11:04 |
sfan5 |
yes you can do that too |
11:04 |
IhrFussel |
I don't know much about python I thought maybe it surpresses the stdout stream or something |
11:05 |
sfan5 |
no it doesnt |
11:06 |
IhrFussel |
Okay then |
11:10 |
sfan5 |
IhrFussel: https://gist.github.com/sfan5/52917a0e1338bcda2176edbc416dae60#file-z_analyze-sh |
11:19 |
|
Jordach joined #minetest |
11:19 |
MinetestBot |
Jordach: Sep-09 17:48 UTC <Krock> eww. if it only was LE:ET time |
11:32 |
|
Fixer joined #minetest |
11:34 |
|
PseudoNoob joined #minetest |
11:34 |
IhrFussel |
sfan5, thanks a lot |
12:00 |
|
est31 joined #minetest |
12:26 |
|
TheReaperKing joined #minetest |
12:28 |
|
VirusJones joined #minetest |
12:31 |
|
namach joined #minetest |
12:33 |
IhrFussel |
sfan5, I run it now and have all the data of blocks > 10k in my file...now should I just grep for specific nodes I think could cause the size and count the results? |
12:34 |
sfan5 |
no you can't grep for nodes in the output |
12:34 |
sfan5 |
what you need to do is take a look at what the script said |
12:34 |
sfan5 |
and see which parts of the mapblock are big |
12:35 |
IhrFussel |
But the file lists them - 0x0000 / 'default:sand' - 0x0001 / 'default:stone' |
12:36 |
sfan5 |
yes but that doesn't mean anything |
12:36 |
sfan5 |
it just tells you that the node is preset somewhere |
12:36 |
IhrFussel |
What's weird is that some mapblocks seem to contain more than 16 nodes |
12:36 |
sfan5 |
why is that weird |
12:36 |
IhrFussel |
Oh sorry my fault |
12:37 |
IhrFussel |
I didn't think 16^3 |
12:37 |
sfan5 |
pastebin what the script says for your biggest mapblock somewhere |
12:37 |
sfan5 |
(the first output) |
12:46 |
IhrFussel |
sfan5, until the first ------------ pos --------- line? |
12:54 |
IhrFussel |
sfan5, here http://pastebin.com/R73AUWQh but I know for a fact that the lags also happen with mapblocks that don't contain many monsters |
12:56 |
|
lumidify joined #minetest |
12:57 |
IhrFussel |
sfan5, here an example of a mapblock that's huge even though almost no static data http://pastebin.com/mVvmP1fB |
12:58 |
IhrFussel |
Or static objects* |
13:02 |
IhrFussel |
It highly seems like I was right..it is the metadata |
13:13 |
|
TheReaperKing1 joined #minetest |
13:43 |
|
jojoa1997 joined #minetest |
13:55 |
|
alkotob_ joined #minetest |
13:55 |
|
yang2003 joined #minetest |
14:03 |
|
lumidify joined #minetest |
14:09 |
|
Krock joined #minetest |
14:11 |
agaran |
IhrFussel: I am afraid you may be right, problem is that you can't remove metadata really.. or many things stop to work.. |
14:17 |
IhrFussel |
agaran, I'm guessing you can delete whole blocks from the DB without corruption and that should also erase the metadata from those blocks |
14:17 |
agaran |
IhrFussel: I'd say so but that will mean some part of world will dissappear too... |
14:18 |
IhrFussel |
agaran, that should still be better than resetting the entire map |
14:19 |
agaran |
IhrFussel: hmm yes but with scripts mentioned you can find out what actually makes that metadata amounts and make sure that there will be bit less of it generated of possible.. |
14:20 |
IhrFussel |
agaran, it's all the homedecor/computer stuff...there can be done nothing other than erasing the blocks with too much of them |
14:20 |
|
alkotob joined #minetest |
14:20 |
agaran |
hmm, I'd check which homedecor/computer blocks and maybe consider removing some of them from world? |
14:20 |
IhrFussel |
Many houses contain LOTS of furniture and many homedecor nodes store metadata |
14:21 |
IhrFussel |
That would take a long time and a lot of effort |
14:23 |
agaran |
IhrFussel: hmm ok, just thinking aloud.. I did not know that so much homedecor uses metadata.. most of ones I used were just static blocks.. |
14:23 |
IhrFussel |
I'd have to dig every single node in order to really erase its metadata |
14:25 |
agaran |
hmm, crazy approach would be to change database format slightly to permit uncompressed blocks to see how muchof that is IO time and how much is cpu bottleneck.. |
14:30 |
|
Out`Of`Control joined #minetest |
14:30 |
|
Out`Of`Control joined #minetest |
14:31 |
IhrFussel |
agaran, I actually don't really understand how 100 KB of compressed DB data can cause major server lags on a 2.8 Ghz dualcore machine with a SSD |
14:32 |
|
Void7 joined #minetest |
14:33 |
agaran |
IhrFussel: neither me, but turning off compression could rule that out.. see my point? |
14:33 |
|
Out`Of`Control joined #minetest |
14:34 |
IhrFussel |
Since it is only the Server thread and AFAIK the Emerge-0 thread manages DB reads/writes I'm guessing it's to do with the compression/umcompression |
14:34 |
agaran |
or serialization.. |
14:35 |
IhrFussel |
agaran, what exactly happens there with the data? |
14:35 |
agaran |
well structure written to db is different than in-memory, so you have to prepare that, pass to compressor, glue chunks together, write to db, on read you have opposite.. |
14:36 |
Hirato |
if it's just zlib compression, you can try lowering the compression level |
14:36 |
agaran |
since map format is really local to server one in theory could use custom one not affecting players |
14:36 |
Out`Of`Control |
hi |
14:36 |
agaran |
Hirato: there are 2 packed chunks one after another, before there is some fixed-width data, and after there is more variable width data.. |
14:36 |
agaran |
this is for one block that is.. |
14:37 |
|
KaadmY joined #minetest |
14:37 |
Hirato |
6 should probably give you a good ratio of size and compression time |
14:37 |
IhrFussel |
agaran, so in other words the engine needs to translate each mapblock on after read/before write to DB? |
14:37 |
agaran |
IhrFussel: yep, translate, compress, work on translating little bit more.. write.. |
14:38 |
IhrFussel |
But we are talking about <1 MB of processing data...I kinda don't want to believe that a Xenon machine with 64-bit couldn't do that without delay |
14:40 |
agaran |
IhrFussel: well depends how many times per second it does that.. |
14:40 |
agaran |
I did not look into mt code. |
14:40 |
agaran |
IhrFussel: and if you have backup of that 170k block, we can check how big it was after decompression.. |
14:42 |
IhrFussel |
agaran, it seems like every node data is 16384 bytes umcompressed, the actual compressed size doesn't matter |
14:42 |
agaran |
nope.. |
14:42 |
IhrFussel |
agaran, - Compressed node data (353 bytes, 16384 bytes uncompressed) |
14:42 |
agaran |
this is first compressed block, it has fixed size yes |
14:42 |
agaran |
then you have metadata chunk, it size varies |
14:43 |
IhrFussel |
agaran, the 170k block is the one with 240 objects |
14:43 |
agaran |
I tried with 40 chests and barelly got to 16kb.. |
14:43 |
agaran |
not filled them up yet |
14:44 |
IhrFussel |
agaran, this is from a mapblock with only 3 objects - Compressed map metadata (20646 bytes, 132108 bytes uncompressed) |
14:44 |
agaran |
130k metadata.. wow.. |
14:44 |
agaran |
in 3 objects.. |
14:45 |
IhrFussel |
And like I said it contains quite a few homedecor nodes |
14:46 |
agaran |
any particular ones so I can test locally? |
14:50 |
IhrFussel |
agaran, nope it's a colorful mix |
14:50 |
IhrFussel |
Since almost all nodes from homedecor use mesh I think that's one reason no? |
14:50 |
agaran |
hmm, might be, I almost never use mesh nodes.. |
14:51 |
|
Elinvention joined #minetest |
14:51 |
IhrFussel |
agaran, hold on I'll grep for certain homedecor nodes and see the total count |
14:51 |
|
Ronsor joined #minetest |
14:54 |
IhrFussel |
agaran, focus on stuff that players would put in their rooms since it looks like many mapblocks with furniture without metadata such as colored sofas also mostly contain homedecor stuff |
14:54 |
|
behalebabo joined #minetest |
14:57 |
IhrFussel |
agaran, especially refrigerators, cabinets, ovens and microwaves since those act as storage |
14:59 |
agaran |
but those should be no worse than chests.. |
14:59 |
IhrFussel |
agaran, chests are mentioned almost 500 times in the >5k blocks |
15:00 |
IhrFussel |
I'm guessing it's the summary of all the storage nodes containing metadata |
15:02 |
agaran |
but then you can't really avoid those.. |
15:02 |
IhrFussel |
agaran, we could try to to do a map backup later, then erase all mapblocks >10k at least and run the world with the new DB file |
15:03 |
IhrFussel |
Then see which parts of the map are destroyed |
15:03 |
agaran |
hmm.. I wonder if that will kill my place too;) |
15:03 |
IhrFussel |
It would be easier to find the bad blocks then I imagine |
15:04 |
agaran |
well, probably, knowing that you have huge db |
15:04 |
agaran |
also finding blocks where no player build/claimed and are underground and were just generated for candidates to deletion might make sense too.. |
15:04 |
IhrFussel |
homedecor: is 3,990 times in >5k blocks |
15:05 |
agaran |
though that may be tricky, some of such regions may be used as walkways.. |
15:05 |
IhrFussel |
lightsplus is 419 times in the blocks |
15:06 |
IhrFussel |
moreblocks is 1,251 times ... likely the saw |
15:06 |
agaran |
or results of saw.. |
15:07 |
agaran |
right mostly saw itself not even results, results don't have metadata |
15:07 |
|
whitephoenix joined #minetest |
15:08 |
IhrFussel |
agaran, the results of sfan5's script don't only display nodes with metadata so it's just guesses...but homedecor is by FAR the first place in terms of huge metadata |
15:09 |
IhrFussel |
I don't think normal chests cause the lags cause they are likely all over the map...homedecor stuff on the other hand is mostly in houses |
15:10 |
agaran |
yes, I know, I have only some light from homedecor.. |
15:11 |
sfan5 |
yes with the script you can only make guesses |
15:11 |
IhrFussel |
Yup but homedecor has tons of furniture...many players want a nice looking house so they buy (before we removed the shops) lots of homedecor furniture and place it in their houses |
15:11 |
sfan5 |
you would actually need to look at the metadata and node data to get accurate results |
15:12 |
agaran |
sfan5: I wonder, if I make map-write code to write new map version.. and add support for that version to reader inside MT server, then it would slowly upgrade map to new format, during read/writes of blocks? |
15:12 |
IhrFussel |
sfan5, but if almost every bad block mentions homedecor it's safe to say it is the problem I think |
15:14 |
sfan5 |
yes |
15:14 |
sfan5 |
agaran: you mean if you have code that writes the old format? |
15:14 |
|
lumidify joined #minetest |
15:14 |
IhrFussel |
That would perfectly explain why the world got slowly less reponsive over time...in May everything was fine, in June nobody mentioned lags, in July some people noticed lags, August most players told me about lags |
15:15 |
agaran |
sfan5: I mean to add to current MT code, that it can read some new format and write some new format of blocks in DB, with a bit reorganized stuff to make less decompressions necesary etc.. |
15:15 |
IhrFussel |
I added shops in July meaning homedecor stuff for a few steel ingots...it all makes sense |
15:15 |
sfan5 |
oh you mean that |
15:15 |
sfan5 |
yes it would do that |
15:16 |
sfan5 |
but there isn't any way to make less decompressing neccessary |
15:16 |
sfan5 |
minetest needs everything anyway |
15:16 |
agaran |
sfan5: well I mean, seek offsets, maybe node data and node metadata in one package.. or optionally uncompressed one of them.. etc.. |
15:17 |
agaran |
to find out which part of operations actually is problem |
15:17 |
|
HonoredGlory joined #minetest |
15:19 |
IhrFussel |
It would even make more sense if ABMs wait until all node metadata was loaded before firing |
15:19 |
Megaf |
IhrFussel: define lag please |
15:20 |
Krock |
#define LAG 65535 |
15:20 |
IhrFussel |
Megaf, entire server freezes for X seconds..no log action, chat messages hang etc |
15:20 |
Megaf |
What's your value for active block range? |
15:21 |
Megaf |
Krock: LoL |
15:21 |
Krock |
#undef LAG |
15:21 |
namach |
greetings all :) can anyone point a good PvP hardcore server, lots of fighting and lots of challenge :) |
15:21 |
IhrFussel |
It's 1 but that doesn't help |
15:22 |
Krock |
maybe the extreme survival server, namach ? |
15:22 |
|
Jousway joined #minetest |
15:22 |
Megaf |
I haven't had a slowdown or crash on my server in a long while. But my average max player is 5 or 6 |
15:22 |
Megaf |
IhrFussel: you have bees, darkage or castle mod? |
15:22 |
Megaf |
Or any mobs? |
15:22 |
namach |
Krock i have played there but it is not populated; PVP is the key word for me :) |
15:23 |
IhrFussel |
I'm fighting this lag problem for weeks now and I tried recompiling the engine, removing all mods, increasing all ABM intervals, removing objects...the lags still happen so it can ONLY be the DB |
15:23 |
namach |
VikingCrafters was my choice (though much of kiddies there) but it is down today and may not go up |
15:23 |
Krock |
namach, then it sounds like you MUST (really painful and hurting :P) test all PVP-enabled servers |
15:24 |
Ronsor |
'/w 5 |
15:24 |
Krock |
good servers come and go |
15:24 |
namach |
Krock i am doing it... but it is really painful... i am about to start bleeding :) |
15:24 |
Krock |
good. This shows that PvP works fine |
15:25 |
IhrFussel |
Megaf, sfan5 made a script for me that translates the hex data from DB into readable values and almost all mapblocks with a size of >5000 contain homedecor nodes and up to 100,000 bytes of uncompressed map meta data |
15:25 |
Megaf |
IhrFussel: the mods I mentioned caused lots of lag on my server |
15:25 |
namach |
interesting point of view... not that pleasant for me :) |
15:26 |
|
MrBeNNy joined #minetest |
15:27 |
agaran |
IhrFussel: silly idea, do openssl speed on your server, and on your home machine.. if server has significantly faster cpu then shouldn't get lower values.. |
15:27 |
IhrFussel |
Some large mapblocks have 20 or so objects attached to them but most of them just have a huge amount of meta data |
15:27 |
agaran |
maybe your vps is throttled on cpu that causes lagging on cpu-intense ops? |
15:27 |
|
Ronsor joined #minetest |
15:28 |
IhrFussel |
agaran, I read somewhere that an easy "benchmark" is echo {1..999999} |
15:29 |
agaran |
that will stress more your ssh session to server sometimes.. |
15:29 |
agaran |
not server cpu.. |
15:30 |
IhrFussel |
agaran, an endless loop should stress the server like while true; do date; done |
15:31 |
agaran |
well but you have no indication of loops per second.. |
15:31 |
agaran |
ah, date.. well still date stream will load your ssh to server sometimes more than cpu itself |
15:31 |
agaran |
while openssl speed does exactly speed of crypto ops.. |
15:32 |
|
Tux[Qyou] joined #minetest |
15:32 |
IhrFussel |
agaran, well what's the command then? Or option |
15:32 |
sfan5 |
IhrFussel: could you pastebin the hex data of a big mapblock? |
15:32 |
sfan5 |
i can take a look whats in the metadata |
15:33 |
agaran |
openssl is a command, openssl speed is is just calling speed test in openssl tool which is frontend tool for openssl-lib |
15:33 |
Ronsor |
or you could use the UNICKS time command |
15:33 |
IhrFussel |
Here the largest but with many objects http://pastebin.com/R73AUWQh ... and here one with only 3 objects but huge meta data http://pastebin.com/mVvmP1fB |
15:34 |
sfan5 |
no i meant the hex data |
15:34 |
IhrFussel |
Oh one sec |
15:35 |
sfan5 |
do a SELECT HEX(data) FROM blocks WHERE pos = -402649135; |
15:37 |
IhrFussel |
sfan5, http://pastebin.com/fwaUASxW |
15:37 |
sfan5 |
thanks |
15:39 |
sfan5 |
hm |
15:40 |
sfan5 |
lots of inventories |
15:40 |
sfan5 |
well this thing (whatever it is?) |
15:40 |
sfan5 |
has one inventory list |
15:40 |
sfan5 |
with 1001 items |
15:40 |
sfan5 |
every single possible node apparently |
15:40 |
sfan5 |
seems to be a craftguide |
15:40 |
agaran |
looks like huge storage.. |
15:40 |
sfan5 |
nah items doesnt mean that you can actually use those |
15:40 |
agaran |
i know |
15:41 |
agaran |
but they take space.. |
15:41 |
sfan5 |
List main 1001 |
15:41 |
sfan5 |
Width 0 |
15:41 |
sfan5 |
Item 3d_armor:boots_bronze |
15:41 |
sfan5 |
[...] |
15:41 |
IhrFussel |
sfan5, yes the block contains a craftguide...I'll look for one without one |
15:41 |
sfan5 |
Item xpanes:pane |
15:41 |
sfan5 |
EndInventoryList |
15:41 |
sfan5 |
no i found your problem already |
15:41 |
sfan5 |
craftguides are horribly inefficient on storage |
15:42 |
agaran |
so abm to replace them with air? + removing node ? |
15:43 |
agaran |
most players don't use craftguides.. I can live without it too |
15:44 |
agaran |
sfan5: hmm couldn't inventory use same mapping as node use, (one with list integer to node-name on end of block data), that at least would make inventories bit more efficient.. |
15:44 |
|
Jordach joined #minetest |
15:44 |
sfan5 |
it doesnt |
15:45 |
sfan5 |
it uses the same horrible text format as the player files |
15:45 |
agaran |
yes I know |
15:45 |
sfan5 |
there's possibility for improvement obviously |
15:45 |
agaran |
thats why I ask if that sort of change would help.. |
15:45 |
agaran |
2 bytes of fixed width node-type vs string.. |
15:46 |
sfan5 |
it would help |
15:46 |
sfan5 |
but the main problem here is homedecor |
15:46 |
sfan5 |
IhrFussel: i can take a look at a mapblock without homedecor too if you want |
15:47 |
IhrFussel |
sfan5, I found one with 77k uncompressed meta but 0 objects and only air |
15:47 |
agaran |
hooow? |
15:47 |
agaran |
leftover metadata? |
15:47 |
sfan5 |
i wanna see thatone |
15:47 |
Krock |
agaran, yes I bet. |
15:47 |
agaran |
lonelly abandoned timers? |
15:48 |
sfan5 |
nah timers are not in metadata |
15:49 |
agaran |
IhrFussel: reecently that self-teleport bug drops me usually at about -212k,y,few-thousands.. fun to see how it TPs me repeatedly to get me closer to legal world.. |
15:49 |
namach |
sorry for interrupting current conversations: anyone know how i can get access to Xanadu server? |
15:50 |
IhrFussel |
sfan5, http://pastebin.com/EJ5PyXZ9 |
15:51 |
sfan5 |
thanks |
15:51 |
sfan5 |
i'll look at that one shortly |
15:52 |
IhrFussel |
agaran, I'll fix it in a few |
15:53 |
agaran |
IhrFussel: not big deal, I do /home and it is fine |
15:53 |
sfan5 |
well that's interesting |
15:53 |
sfan5 |
hundreds of empty inventories |
15:54 |
Krock |
that's called potential to save space! |
15:54 |
IhrFussel |
sfan5, can I delete those blocks with only air safely? |
15:54 |
sfan5 |
probably |
15:55 |
Krock |
I wouldn't do it if you have changed the mapgen settings somewhen |
15:55 |
|
Fixer_ joined #minetest |
15:55 |
IhrFussel |
I never touch mapgen settings...you are talking about map.meta right? |
15:55 |
IhrFussel |
map_meta.txt I think it is |
15:56 |
sfan5 |
yes map_meta |
15:58 |
IhrFussel |
sfan5, could those empty inventories be caused by WorldEdit when replacing nodes with meta? |
15:58 |
sfan5 |
i'm not sure |
15:58 |
sfan5 |
but probably not |
16:08 |
Out`Of`Control |
how long takes clearobjects full? |
16:08 |
sofar |
depends on world size (total generated) |
16:08 |
sofar |
could be short (new world) could be minutes |
16:09 |
Out`Of`Control |
24GiB |
16:09 |
Krock |
also depends on disk speed |
16:09 |
Out`Of`Control |
SSD |
16:09 |
sofar |
expect it to take a while :) |
16:13 |
Out`Of`Control |
hours days? |
16:14 |
sofar |
honestly I can't say, it's just very dependent on many performance aspects |
16:15 |
Out`Of`Control |
i don't see any progress, could be that its frozen? |
16:16 |
|
edgrey joined #minetest |
16:17 |
Megaf |
[17:08:22] <Out`Of`Control> how long takes clearobjects full? |
16:17 |
|
edgrey joined #minetest |
16:17 |
Megaf |
on my server, several hours |
16:17 |
Megaf |
[17:15:19] <Out`Of`Control> i don't see any progress, could be that its frozen? |
16:17 |
Megaf |
There's no progress indicator |
16:18 |
Out`Of`Control |
Megaf: on old version i could see cpu going up/down now there is nothing |
16:18 |
Megaf |
Out`Of`Control: https://github.com/minetest/minetest/issues/1620 |
16:18 |
Megaf |
!title |
16:18 |
MinetestBot |
Megaf: Progress bar/status/info for /clearobjects. · Issue #1620 · minetest/minetest · GitHub |
16:20 |
Out`Of`Control |
that would be great |
16:23 |
|
edaq joined #minetest |
16:24 |
|
hmmmm joined #minetest |
16:28 |
nolsen |
!mod playereffects |
16:28 |
MinetestBot |
nolsen: Player Effects [playereffects] by Wuzzy - https://forum.minetest.net/viewtopic.php?t=9689 |
16:28 |
nolsen |
Why is playereffects broken? |
16:29 |
sfan5 |
hm strange |
16:30 |
sfan5 |
IhrFussel: i found a mapblock with lots of empty inventories in one of my worlds too |
16:30 |
nolsen |
https://nolsen.xyz/paste/?5bf9d26d3b70dca7#WvZBhymnYewzyNfJMLJFSe0db8T8yr3xzuoUkMyK/Ts= |
16:30 |
IhrFussel |
sfan5, did you use WE in it? |
16:30 |
sfan5 |
probably not |
16:31 |
IhrFussel |
I found at least 10 of those "only 1 or 2 nodes 0 objects but >50k meta" blocks |
16:31 |
sfan5 |
looks like some part of a forest (default:dirt_with_grass, default:leaves) where i just placed a default:chest |
16:32 |
sfan5 |
my guess: a previous version of minetest had the bug of writing lots of empty invs to metadata |
16:33 |
IhrFussel |
sfan5, that is indeed possible..0.4.13-dev created my DB |
16:34 |
sfan5 |
this "test" map i'm looking at was used since probably 0.4.11 or something |
16:34 |
sfan5 |
some more emptyinventories in this mapblock too |
16:35 |
sfan5 |
hmmmm |
16:35 |
sfan5 |
(oops that was a highlight) |
16:38 |
nolsen |
I guess I will just disable playereffects, since nobody knows :\ |
16:39 |
IhrFussel |
sfan5, the uncompressed metadata in all of these "only air" nodes is the exact same size 72,963 |
16:39 |
IhrFussel |
blocks* |
16:41 |
IhrFussel |
My world seems to have WAY MORE than just 10 of these..I'm at 30 now |
16:43 |
agaran |
sfan5: but it would be safe to walk over those nodes and replace metadata blob part with empty blob piece? |
16:43 |
sfan5 |
that's only safe if you know that there is only "air" |
16:43 |
agaran |
yes, that was assumption |
16:43 |
sfan5 |
the better variant would be deleteing empty invs from meta |
16:44 |
agaran |
you can't load meta for nonexisting object? |
16:44 |
agaran |
otherwise walking over map block and loading meta for pos, cleaning then writing would do job, even if in crude way |
16:44 |
sfan5 |
no you need to do this cleaning on the raw mapblock data |
16:44 |
sfan5 |
you can't do it from a lua mod |
16:45 |
sfan5 |
(probably not, at least) |
16:45 |
agaran |
thats what I was afraid of.. |
16:46 |
IhrFussel |
sfan5, all the mapblocks have the exact same block size (5813 bytes), exact same node (48 bytes, 16384 bytes uncompressed) and meta (5741 bytes, 72963 bytes uncompressed) size |
16:46 |
IhrFussel |
In my world at least |
16:46 |
sfan5 |
https://github.com/minetest/minetest/issues/4516 |
16:49 |
IhrFussel |
Correction: block sizes vary |
16:50 |
sfan5 |
obviously they do |
16:50 |
sfan5 |
in my world this inventory thing seems to happen with random mapblocks |
16:50 |
sfan5 |
i.e. they also have e.g. stone/ores or trees/leaves |
16:50 |
sfan5 |
s/i.e. // |
16:50 |
IhrFussel |
sfan5, now I found one block with air and wool and 73k meta |
16:51 |
agaran |
generous meta-wool? |
16:51 |
IhrFussel |
wool:cyan |
16:51 |
sfan5 |
hm i should research the meta format |
16:57 |
|
Fixer joined #minetest |
16:58 |
|
Telesight joined #minetest |
17:00 |
IhrFussel |
"grep -A 12 "pos =" results.txt | grep -E "mapping count: 1$" | wc -l" shows 653 o.o |
17:11 |
sfan5 |
- Variable count: 1682534006 |
17:11 |
sfan5 |
ok this doesnt seem right |
17:11 |
sfan5 |
:D |
17:13 |
agaran |
unless you have 1TiB map ;) |
17:14 |
Calinou |
my minetest-survival map is 1.2 GB, and contains 32 MB of player files |
17:14 |
agaran |
Calinou: today somebody mentioned 24GiB map.. |
17:14 |
Calinou |
8,125 player files |
17:14 |
Calinou |
lol, I see tons of patterns in the names |
17:15 |
Calinou |
Peterxxxx for example |
17:15 |
Calinou |
there are more than 10 of those |
17:15 |
agaran |
<name><numbers> |
17:15 |
Calinou |
"hitler1" |
17:15 |
Calinou |
only one? wow |
17:15 |
Calinou |
"hentai" |
17:15 |
Calinou |
"aaaaaaaa..." too |
17:16 |
agaran |
voxel hentai.. thats new |
17:16 |
Krock |
and perhaps boring |
17:16 |
agaran |
likelly.. |
17:16 |
Calinou |
"XxX_HacKer_XxX" |
17:17 |
sfan5 |
why doesnt' this metadata look like described in the source |
17:17 |
sfan5 |
:( |
17:19 |
agaran |
because bad metadata this is? |
17:19 |
sfan5 |
anyone have a mapblock with definitely correct metadata handy? |
17:20 |
agaran |
I should, created on 4.14 stable |
17:20 |
sfan5 |
actually nvm something else seems to be very wrong |
17:23 |
sfan5 |
ok |
17:23 |
sfan5 |
agaran: would be nice if you had a valid mapblock |
17:23 |
agaran |
does have to be long? |
17:25 |
sfan5 |
no |
17:25 |
sfan5 |
it just needs metadata |
17:25 |
agaran |
http://pastebin.com/SDtLHsDr |
17:25 |
sfan5 |
ok thanks |
17:25 |
sfan5 |
nope that doesnt work either |
17:25 |
sfan5 |
so it's my fault |
17:26 |
sfan5 |
it seems to fuck up everytime there's a serialized inventory |
17:26 |
sfan5 |
ok what the fuck is this |
17:26 |
|
Szkodnix joined #minetest |
17:27 |
sfan5 |
there's EndInventory just sprinkled in there |
17:27 |
sfan5 |
just out of nowhere |
17:28 |
agaran |
http://pastebin.com/CVS2qcWq |
17:28 |
agaran |
alternative one |
17:29 |
agaran |
second has some chests etc.. |
17:29 |
sfan5 |
ok wait |
17:29 |
|
DMackey joined #minetest |
17:30 |
sfan5 |
oh i missed a line of code |
17:33 |
sfan5 |
this string serializing is horrible |
17:38 |
sfan5 |
yay |
17:43 |
sfan5 |
agaran: here's your mapblock http://sprunge.us/OChJ |
17:44 |
agaran |
neat decoder script :) |
17:46 |
Krock |
yeah, well done |
17:54 |
|
T4im joined #minetest |
17:56 |
sfan5 |
IhrFussel: where do your craftguides come from? |
17:56 |
sfan5 |
which mod |
18:00 |
sfan5 |
actually i should be able to find that out myself |
18:00 |
agaran |
sfan5: i can check, moment |
18:01 |
agaran |
craft_guide:sign_wall |
18:02 |
sfan5 |
>Item craft_guide:sign_wall |
18:02 |
sfan5 |
ye |
18:02 |
T4im |
not to be confused with mod "craftguide", which doesn't use nodes :) |
18:03 |
agaran |
sfan5: on mod list there is also craft_guide |
18:03 |
sfan5 |
!mod craft_guide |
18:03 |
MinetestBot |
sfan5: Zeg9's craft guide [zcg] by Zeg9 - https://forum.minetest.net/viewtopic.php?t=5564 |
18:03 |
sfan5 |
>2013 |
18:03 |
sfan5 |
probably not that one |
18:03 |
T4im |
no sign in there, no |
18:05 |
T4im |
does it have lcd stuff? |
18:05 |
agaran |
no just plain sign-alike thing on wall |
18:09 |
sfan5 |
https://github.com/cornernote/minetest-craft_guide |
18:11 |
T4im |
lets hope there won't be any "wikipedia nodes" anytime soon |
18:12 |
T4im |
:D |
18:20 |
everamzah |
so i went looking for leveled nodes, which lua_api.txt lists as (water, snow), but lo and behold there aren't any leveled nodes in minetest_game! /triva |
18:20 |
everamzah |
o/ |
18:21 |
IhrFussel |
sfan5, sorry was shopping... |
18:21 |
agaran |
IhrFussel: it happens, so called food-storage restocking ;) |
18:23 |
agaran |
sfan5: on some places in server there may be leftover of smartshops.. which got removed.. not sure how removed so not sure if metadata left or not |
18:25 |
IhrFussel |
sfan5, my craft guide is this one https://github.com/cornernote/minetest-craft_guide/archive/master.zip |
18:25 |
|
Void7 joined #minetest |
18:26 |
IhrFussel |
Project page https://github.com/cornernote/minetest-craft_guide |
18:28 |
|
PseudoNoob joined #minetest |
18:38 |
agaran |
IhrFussel: can I have an idea to /status command? |
18:38 |
IhrFussel |
agaran, you mean tell an idea? |
18:39 |
agaran |
IhrFussel: yep, to add marker to list of players for those who have /hpm enabled |
18:41 |
|
moparisthebest joined #minetest |
18:47 |
IhrFussel |
agaran, I cannot modify the status string it's a core function inside c++ I think |
18:47 |
IhrFussel |
I probably could change it to my own function but the question is does the lua API tell the server lag somewhere |
18:48 |
agaran |
IhrFussel: so /who maybe that shows hpm/spm status ? |
18:49 |
|
GunshipPenguin joined #minetest |
18:50 |
|
lumidify joined #minetest |
18:59 |
IhrFussel |
agaran, should work after restart |
18:59 |
agaran |
IhrFussel: wow, :) |
18:59 |
IhrFussel |
Didn't find a Lua function to get the server uptime and lag so had to go with /who |
18:59 |
agaran |
thats fine for me |
19:06 |
IhrFussel |
WHAT THE HECK |
19:07 |
agaran |
lagged as hell if you ask me |
19:07 |
IhrFussel |
10 messages or so lagged |
19:07 |
agaran |
I was moving items and they were moving back.. |
19:13 |
agaran |
IhrFussel: ups, I crashed server? |
19:17 |
IhrFussel |
agaran, try again now |
19:17 |
agaran |
tried.. |
19:19 |
IhrFussel |
agaran, again please |
19:20 |
IhrFussel |
agaran, that was now cause the bot has a command "shutdown" and the engine has its own "shutdown" |
19:20 |
agaran |
no problem at all, tests are my daily stuff..;) |
19:21 |
IhrFussel |
agaran, works now? |
19:22 |
agaran |
I'd say.. does not crash ;) but I wouldn't call that working |
19:22 |
agaran |
only output I get is [enabled] |
19:22 |
agaran |
no player list etc.. |
19:23 |
IhrFussel |
I think I'm not understanding scope of variables...if I want to loop through players and append the names plus a string to a variable do I have to declare the variable BEFORE the loop? |
19:23 |
agaran |
output one? yes |
19:24 |
agaran |
local msg = ''; for _,k in ipairs(list) ... msg = msg .. ", "..k done |
19:24 |
agaran |
s/done/end/, meh too much bash @work |
19:26 |
|
rubenwardy joined #minetest |
19:26 |
IhrFussel |
Okay I think I got it now |
19:28 |
Krock |
table.concat(list, ", ") |
19:28 |
agaran |
Krock: hmm thats too easy ;) |
19:28 |
Krock |
I know :P |
19:29 |
agaran |
Krock, got place where I can run server, so someday it will be possible to see that modified cable code in work.. |
19:30 |
Krock |
\o/ |
19:30 |
agaran |
IhrFussel: now it displays people right, :) |
19:31 |
|
swift110 joined #minetest |
19:32 |
|
swift110 joined #minetest |
19:35 |
IhrFussel |
Thanks agaran for the help |
19:37 |
agaran |
yw |
19:41 |
IhrFussel |
agaran, I'd like to know if the end-of-map bug still happens and if it happens in both directions or just X/Z positive/negative values |
19:41 |
agaran |
give me moment to get there then |
19:42 |
IhrFussel |
agaran, first X please |
19:43 |
agaran |
got teleported 100 paces back on X only, rest intact |
19:43 |
IhrFussel |
Okay then Z now |
19:43 |
agaran |
z too |
19:44 |
IhrFussel |
Then negative X nopw |
19:44 |
agaran |
negative x works |
19:45 |
agaran |
ok need to wait for dau to end.. |
19:45 |
agaran |
-z works as well |
19:46 |
IhrFussel |
agaran, then it likely happens when one is + and the other - |
19:46 |
agaran |
yes, it can be.. |
19:49 |
agaran |
nope, even going diagonally does not make it misbehave.. it does when due to bug in client I get teleported far away.. it fixes one axis by addition but then makes other worse because also uses addition I think.. |
19:49 |
agaran |
now it works properly |
19:50 |
IhrFussel |
agaran, okay good =) |
19:52 |
|
GunshipPenguin joined #minetest |
19:53 |
|
GunshipPenguin joined #minetest |
19:53 |
agaran |
IhrFussel: another issue with that, though not big deal.. it can tp person to solid wall.. |
19:55 |
IhrFussel |
agaran, players can still use /teleport or spawn if that really happens |
19:55 |
agaran |
yep |
19:55 |
IhrFussel |
Barely any player flies to the map limit |
19:58 |
agaran |
sure, I understand that |
20:02 |
|
ploop joined #minetest |
20:08 |
|
ploop joined #minetest |
20:08 |
|
DMackey joined #minetest |
20:09 |
|
Tmanyo joined #minetest |
20:10 |
|
xSmurf joined #minetest |
20:14 |
|
Fixer_ joined #minetest |
20:17 |
Jordach |
:O |
20:17 |
Jordach |
Megaf, VRAM / Sample corruption has stopped |
20:20 |
|
ploop joined #minetest |
20:21 |
IhrFussel |
agaran, didn't find abetter color for teleport request text yet? =P |
20:21 |
agaran |
IhrFussel: nope, nothing good.. I stay underground so most of stuff is dark.. but on surface most of things are green.. |
20:22 |
IhrFussel |
agaran, maybe darkred |
20:23 |
agaran |
might be good |
20:25 |
|
ploop joined #minetest |
20:27 |
IhrFussel |
agaran, this one? http://www.colorpicker.com/c40000 |
20:28 |
agaran |
might be good or little too dark for underground.. |
20:28 |
agaran |
don't make me have more ideas what to improve;) |
20:30 |
IhrFussel |
http://www.colorpicker.com/c90000 |
20:33 |
agaran |
looks fine |
20:35 |
|
ploop joined #minetest |
20:35 |
|
AcidNinjaFWHR joined #minetest |
21:47 |
IhrFussel |
agaran, are you good at Python? Do you know where max_positive var is defined or is it a global variable of Python? |
21:48 |
IhrFussel |
http://pastebin.com/axc9uFQH |
21:49 |
sfan5 |
lmao |
21:49 |
sfan5 |
IhrFussel: it's the second argument to unsignedToSigned |
21:51 |
IhrFussel |
sfan5, oh I see...can i code that function in Bash too? |
21:51 |
sfan5 |
probably not |
21:52 |
sfan5 |
not easily at least |
21:53 |
Megaf |
Jordach: cool! Did you change anything? Maybe a driver update? |
21:53 |
Jordach |
driver update yes# |
21:54 |
Megaf |
heh |
21:57 |
|
Miner_48er joined #minetest |
22:01 |
Megaf |
I'm in part 4 of this. https://www.youtube.com/watch?v=-r4q0reHAC8&list=PLWklwxMTl4swj2iFIjIPsHogwioUFTIxy |
22:01 |
Megaf |
!title |
22:01 |
MinetestBot |
Megaf: The TRUTH about the KATANA, part 1: Introduction - YouTube |
22:04 |
|
Markow joined #minetest |
22:04 |
Megaf |
Hi Miner_48er |
22:05 |
Miner_48er |
hi |
22:17 |
|
est31 joined #minetest |
22:23 |
|
KaadmY joined #minetest |
22:29 |
|
betterthanyou711 joined #minetest |
22:30 |
|
Hirato_ joined #minetest |
22:42 |
|
nyuszika7h joined #minetest |
22:55 |
|
rom1504 joined #minetest |
22:55 |
agaran |
!mod worldedit |
22:55 |
MinetestBot |
agaran: WorldEdit [worldedit] by sfan5 - https://forum.minetest.net/viewtopic.php?t=572 |
22:58 |
|
FirePowi joined #minetest |
23:04 |
|
namach joined #minetest |
23:17 |
|
fingle joined #minetest |
23:19 |
|
fingle left #minetest |
23:24 |
|
yang2003 joined #minetest |
23:30 |
Fixer_ |
Megaf: looool, it seems a big troll war about Katana |
23:32 |
|
lordfingle joined #minetest |
23:35 |
|
yang2003 joined #minetest |
23:38 |
|
yang2003 joined #minetest |
23:40 |
|
Jordach joined #minetest |