OpenSimWorld is the directory of 3D Virtual Worlds based on OpenSimulator and connected through the HyperGrid. Learn More
New Members
Skye Finch, HarryWillliam, Chiplet, BethannKnight, Nhacaiuytingarden, Kevinlevin, Mark Webber, Elkindaza, Lexii, Kingzaraza, Carolinejoe, Bailitufu, Danisun, EneroMetaverso, Dannysage, Alexfar, DJEaglePalmer, Yselle, Zeraphel, RarityLikes
Last update: OSG is back on line.
As you may be aware OSG is off line.
Let me preface this by saying that your data is ok. This is not a crash.
This is a needed house-cleaning procedure that's the product of taking up to four times the space in the server that it's needed for the assets files. So they are re-organising the way the data is stored and adding essentially more space in the server.
In your personal computer that would take about 2 or 3 hours tops, given the size and complexity of the setup of OSGrid that will take about 48 hours. Think that the current ingest of assets of the old server is rounding a quarter of a billion assets... in tiny tiny files.
Think your hard drive, it's like a huge stack of tiny boxes, you can put inside just one piece of information, if you put something that is bigger than one box then you fill as many boxes as necessary until the thing is completely there, that's how it works.
However if you have a bunch of things that are smaller than the box that contains it you waste a TON of space. That's why it's needed to reorganise the data and that's what they're doing right now. So that's the reason why it'll take so long, but as I said before, this is not a crash, just housekeeping, your data is fine.
If I have more updates I'll keep you informed.
https://twitter.com/osgrid/status/1505682546927050761
Aaaand we need another 48 hours. https://twitter.com/osgrid/status/1506385035120844804
Sadly that's what happens when so much data is involved. When I learn more I'll tell you about it.
https://twitter.com/osgrid/status/1507142134184427529
Update: sunday seems to be the day, hopefully.
Update: https://twitter.com/osgrid/status/1507502473417834507
read the reply where I explain it a bit.
Last upate: https://twitter.com/osgrid/status/1507925350415847428?cxt=...
Wednesday seems to be the day!
Update: https://twitter.com/osgrid/status/1508966793032966150
If everything goes as planned Thursday seems to be the re-opening day!
As you may be aware OSG is off line.
Let me preface this by saying that your data is ok. This is not a crash.
This is a needed house-cleaning procedure that's the product of taking up to four times the space in the server that it's needed for the assets files. So they are re-organising the way the data is stored and adding essentially more space in the server.
In your personal computer that would take about 2 or 3 hours tops, given the size and complexity of the setup of OSGrid that will take about 48 hours. Think that the current ingest of assets of the old server is rounding a quarter of a billion assets... in tiny tiny files.
Think your hard drive, it's like a huge stack of tiny boxes, you can put inside just one piece of information, if you put something that is bigger than one box then you fill as many boxes as necessary until the thing is completely there, that's how it works.
However if you have a bunch of things that are smaller than the box that contains it you waste a TON of space. That's why it's needed to reorganise the data and that's what they're doing right now. So that's the reason why it'll take so long, but as I said before, this is not a crash, just housekeeping, your data is fine.
If I have more updates I'll keep you informed.
https://twitter.com/osgrid/status/1505682546927050761
Aaaand we need another 48 hours. https://twitter.com/osgrid/status/1506385035120844804
Sadly that's what happens when so much data is involved. When I learn more I'll tell you about it.
https://twitter.com/osgrid/status/1507142134184427529
Update: sunday seems to be the day, hopefully.
Update: https://twitter.com/osgrid/status/1507502473417834507
read the reply where I explain it a bit.
Last upate: https://twitter.com/osgrid/status/1507925350415847428?cxt=...
Wednesday seems to be the day!
Update: https://twitter.com/osgrid/status/1508966793032966150
If everything goes as planned Thursday seems to be the re-opening day!
Liked by: 
Comments
Bad news: OSgrid will be down until the middle of next week.
Good news #1: It'll be faster afterwards.
Good news #2: Looks like you'll get your missing assets back more quickly.
What say you, is it worth the wait?
https://nitter.1d4.us/osgrid/status/1507925350415847428#m
like(3)
Good news #1: It'll be faster afterwards.
Good news #2: Looks like you'll get your missing assets back more quickly.
What say you, is it worth the wait?
https://nitter.1d4.us/osgrid/status/1507925350415847428#m
there was a life before SL and OpenSim and there is one after .. so we'll just wait and see .. otherwise .. make your own grid .. account in another grid or just do something else ... we'll see if it's at Mid next week stays or later.. time will tell
like(1)
@AnakinSkywalker from PM
AnakinSkywalker 2 hours ago
Germans are nuts!
--------------------------
.... you have brain ?????????????
like(0)
AnakinSkywalker 2 hours ago
Germans are nuts!
--------------------------
.... you have brain ?????????????
tztz Max replay limit is reached ...
@ Kris
I've always been the same since birth and always have the same name.. ah you're referring to the pixel story.... every now and then I change the name and delete the crap to get rid of people with their click rage .. because I only have friends in RL
like(0)
@ Kris
I've always been the same since birth and always have the same name.. ah you're referring to the pixel story.... every now and then I change the name and delete the crap to get rid of people with their click rage .. because I only have friends in RL
@Kris Patrick
I think more that you have no idea ..... I don't know of any company and no hoster and no provider at the moment that has been down as often as OSG in recent years ... and to bring the topic beta back into the mouth take ... how long will the OpenSim be developed ..... 1 year .. 5 years , 10 years ....... 15 years I think longer ....
regarding your first LOL... 1 week is nothing.. no problem shut down your regions for 6 months and you will get what you crave.
like(0)
I think more that you have no idea ..... I don't know of any company and no hoster and no provider at the moment that has been down as often as OSG in recent years ... and to bring the topic beta back into the mouth take ... how long will the OpenSim be developed ..... 1 year .. 5 years , 10 years ....... 15 years I think longer ....
regarding your first LOL... 1 week is nothing.. no problem shut down your regions for 6 months and you will get what you crave.
Wasn't for OSGRID and the hard working people, servicing 150k . You wouldn't be here flapping at the mouth. Can send you a notecard on the history if you wish.
like(2)
there are still 90% of people on this earth who still achieve a lot even after their RL work ....... there is no reason to single out a handful of people .. thank you
like(0)
Do the following experiment: Get a video file on your computer, of about 1 Gb of size. Copy it to another folder and see how long it takes.
Then use zip or rar to compress the file but also subdivide it into 1kb parts, you will get approximately 1 Gb composed of a TON of tiny files, select them all and copy them into somewhere else... See how long it takes.
If you did that, now you have a vague idea of what's going on, now multiply that by 4096 and you will see more or less the dimension of data the guys are managing.
And finally, try to make an estimate on how long would it take to copy all that. And yep, your guess will be wrong too lol.
like(2)
Then use zip or rar to compress the file but also subdivide it into 1kb parts, you will get approximately 1 Gb composed of a TON of tiny files, select them all and copy them into somewhere else... See how long it takes.
If you did that, now you have a vague idea of what's going on, now multiply that by 4096 and you will see more or less the dimension of data the guys are managing.
And finally, try to make an estimate on how long would it take to copy all that. And yep, your guess will be wrong too lol.
I know absolutely nothing about computers when it comes to what you're talking about but to me it sounds like one very huge "de fragmenting" operation.
like(1)
That's a fair question and I can only speculate an answer as I'm not an admin but a regular user that offered myself to be the link between admins with very little time in case of disruptions like this one.
While very similar on the surface Open Sim and Second Life are very different. Someone said OS is an open source fork of SL and I believe it was at first but their technology evolved divergently mostly because money. (Again, this is pure speculation on my part).
We don't have the same levels of resources SL has, this is an open source, volunteer driven project of very few people putting an unholy amount of hours for free just for us to have a place to play around.
Also OS situation is exponentially more complicated than SL.
Think that OS must keep a compatibility, backwards and forwards between multiple forks of itself, in that regard SL has it easy, it's just one closed grid. OS is more like a constellation of grids that sends and receives a huge amount of data constantly.
Think about an hyper jump, suddenly your inventory must be available in another grid, my guess is that the communications between grids, caches, databases, accounts, inventory, etc is just enormous.
So enormous in fact that the asset server(s) have to handle millions of operations every day, in spite of that we're very few users compared with SL the amount of data processed is staggering. With less resources than a paid service. This outage is to literally make more space in the asset server to recover the assets that were transferred from the old datacentre to the new one and to keep operating with the regular ingestion of new assets. We're talking about server grade hardware, for a very niche and specific application that has to be tuned and setup by one or two guys that makes this happen for free.
So to answer your question, I'm sure the approach is different (as far as I understand SL is putting the data in the cloud now), what's going on is also different (not only the space optimization but also the recover of the data from the old asset server), it's running on a shoe string budget by very few people that's doing it for free.
Oh btw, as far as i understand tomorrow things should be up and running again, if something different happens i'll post it here.
Edit: And i did, I didn't realise the Tweet but I understand now the question. Technically is just Microsoft time if you move around 4 huge files it'll take way less time than if you move around 4 million tiny files that results in the same occupied space.
like(1)
While very similar on the surface Open Sim and Second Life are very different. Someone said OS is an open source fork of SL and I believe it was at first but their technology evolved divergently mostly because money. (Again, this is pure speculation on my part).
We don't have the same levels of resources SL has, this is an open source, volunteer driven project of very few people putting an unholy amount of hours for free just for us to have a place to play around.
Also OS situation is exponentially more complicated than SL.
Think that OS must keep a compatibility, backwards and forwards between multiple forks of itself, in that regard SL has it easy, it's just one closed grid. OS is more like a constellation of grids that sends and receives a huge amount of data constantly.
Think about an hyper jump, suddenly your inventory must be available in another grid, my guess is that the communications between grids, caches, databases, accounts, inventory, etc is just enormous.
So enormous in fact that the asset server(s) have to handle millions of operations every day, in spite of that we're very few users compared with SL the amount of data processed is staggering. With less resources than a paid service. This outage is to literally make more space in the asset server to recover the assets that were transferred from the old datacentre to the new one and to keep operating with the regular ingestion of new assets. We're talking about server grade hardware, for a very niche and specific application that has to be tuned and setup by one or two guys that makes this happen for free.
So to answer your question, I'm sure the approach is different (as far as I understand SL is putting the data in the cloud now), what's going on is also different (not only the space optimization but also the recover of the data from the old asset server), it's running on a shoe string budget by very few people that's doing it for free.
Oh btw, as far as i understand tomorrow things should be up and running again, if something different happens i'll post it here.
Edit: And i did, I didn't realise the Tweet but I understand now the question. Technically is just Microsoft time if you move around 4 huge files it'll take way less time than if you move around 4 million tiny files that results in the same occupied space.
No, that's a separate process. Your missing inventory items will be back in some months because those were in the last server of the old datacentre.
That data is being processed and integrated in the new asset server but it takes time as it's literally million upon millions of files.
This downtime happened because that restoring process is taking too much space in the server, so a change had to be made to continue the process, think of it as housekeeping and organising.
Also, please ignore what Pagane said, that may or may be not true but it's 100% unrelated with the current situation and your question.
like(2)
That data is being processed and integrated in the new asset server but it takes time as it's literally million upon millions of files.
This downtime happened because that restoring process is taking too much space in the server, so a change had to be made to continue the process, think of it as housekeeping and organising.
Also, please ignore what Pagane said, that may or may be not true but it's 100% unrelated with the current situation and your question.
If everyone cleaned their inventory, on a regular basis. Quit shopping because everything is free for the taking. Maybe the data base, wouldn't have to work so damn hard.
like(1)
That's very true, but for most people that's exactly the fun they get from the grid(s), so if you negate the reason to be here that would turn it into a barren place. Think it as a service, your users uses your features for a reason, if you remove the most popular feature then your service stops being relevant for them and they migrate away.
I wish it wouldn't be like that, I wish creation of content would be the main reason to log in, but that's not reality and to be honest variety is the key of success, for each creator you need someone that actually uses that creation or the whole process renders moot.
like(1)
I wish it wouldn't be like that, I wish creation of content would be the main reason to log in, but that's not reality and to be honest variety is the key of success, for each creator you need someone that actually uses that creation or the whole process renders moot.
I don't mean stop shopping completely. I mean do you really need. to copy the entire grid you visit?
like(1)
I understand, you're suggesting to practise moderation. Honestly I think that may work for some people, especially old users, but I still remember this panic I had when I logged into OSG for the first time: inventory empty and I didn't even have an avatar! I was just a cloud lol
Granted, today you have a start avatar but in my time you didn't! So the first 2 days I went into a shopping rampage because the contrast with what i had in SL was BRUTAL.
IDK, some people really need to have the whole grid in the inventory to be at ease, others don't and I'm convinced that everyone went through the locusts stage taking everything that's copyable for the sakes to have something in the inventory,
like(0)
Granted, today you have a start avatar but in my time you didn't! So the first 2 days I went into a shopping rampage because the contrast with what i had in SL was BRUTAL.
IDK, some people really need to have the whole grid in the inventory to be at ease, others don't and I'm convinced that everyone went through the locusts stage taking everything that's copyable for the sakes to have something in the inventory,
Really appreciate the hard work that goes into making Osgrid such a special and successful place. And of course we all know that when you start on something complicated on a computer, the final result may be good but there usually are unexpected probs along the way. So will try to be patient! Thank sssssso much admins!
like(2)
If Aaack posts a pic of a Seagate drive, everything will (probably) be fine.
I'd rather be worried if this was a pic of a Hitachi/IBM Deathstar.
like(5)
I'd rather be worried if this was a pic of a Hitachi/IBM Deathstar.
If OS Grid abandons the idea of using HDs and using SSD storage, they will have the fastest assets and fewer problems with old assets.
like(2)