PPCG TF2 Server - Shut down now - 2016-12-22 (page 1 of 2)

Downgoat

00:39

ok will do

Downgoat

01:34

k i did

@quartata

GODDAMMIT

IT STILL GOTTA BORK

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
15916 tf2serv+  20   0  176904  52924  10820 R 17.3 10.5   0:00.61 srcds_linux
15662 tf2serv+  20   0   26128   2040   1276 S  0.3  0.4   0:00.26 tmux
15913 tf2serv+  20   0   23540   2808   2348 R  0.3  0.6   0:00.04 top
    1 root      20   0   28784   3296   1440 S  0.0  0.7   0:07.07 systemd
    2 root      20   0       0      0      0 S  0.0  0.0   0:00.00 kthreadd
    3 root      20   0       0      0      0 S  0.0  0.0   0:01.06 ksoftirqd/0

@quartata pls halp fix bork

quartata

dmesg

and what bork precisely

and I never got confirmation that you had no plugins

ls tf/addons

@Downgoat

Downgoat

Hai

$ ls serverfiles/tf/addons/
source-python  source-python.dll  source-python.so  source-python.vdf

[377985.641429] Out of memory: Kill process 16360 (srcds_linux) score 483 or sacrifice child
[377985.642849] Killed process 16360 (srcds_linux) total-vm:420296kB, anon-rss:244092kB, file-rss:0kB
[378011.835785] [UFW BLOCK] IN=eth0 OUT= MAC=7a:ab:4c:bd:e1:fa:3c:8a:b0:0d:6f:f0:08:00 SRC=1.34.82.90 DST=10.12.0.6 LEN=40 TOS=0x00 PREC=0x00 TTL=52 ID=46033 PROTO=TCP SPT=39858 DPT=23 WINDOW=59148 RES=0x00 SYN URGP=0
[378012.418719] [UFW BLOCK] IN=eth0 OUT= MAC=7a:ab:4c:bd:e1:fa:3c:8a:b0:0d:6f:f0:08:00 SRC=220.133.210.151 DST=104.236.175.143 LEN=40 TOS=0x00 PREC=0x00 TTL=53 ID=26773 PROTO=TCP SPT=3…

@quartata indepth bork data above

quartata

01:57

dude you didn't get rid of source python

@Downgoat

:PPPPPP

Move it out of addons, restart VPS and try again @Downgoat

Downgoat

So it is tf2goat bork

quartata

No. Most likely SP itself

They don't test often on TF2. They're targeting CS:GO more

Downgoat

02:12

ok doing

NOOOOOOO

STILL BORKKKK

YYYYYYYYY

quartata

@Downgoat Make sure you move everything

That directory should be completely empty

ello?

Downgoat

tf2server@vihan:~$ ls -a serverfiles/tf/addons/
.  ..
tf2server@vihan:~$

quartata

What's in your server.cfg

Downgoat

exec banned_user.cfg
exec banned_ip.cfg
writeid
writeip

// Hostname for server.
hostname "PPCG Server"

// RCON - remote console password.
rcon_password "tapSecrit1234"

// Server password - for private servers.
sv_password "blamehooves"

// Server Logging
log on
sv_logbans 1
sv_logecho 1
sv_logfile 1
sv_log_onefile 0

tf_weapon_criticals 0
tf_use_fixed_weaponspreads 1

sv_pausable 1
sv_pure 0
sv_region 1
sv_timeout 100

mp_autoteambalance 0
mp_chattime 10
mp_idledealmethod 2
mp_idlemaxtime 10

@quartata see above

quartata

@Downgoat How are you invoking srcds?

Downgoat

02:20

$ ./tf2server st

quartata

Which does...?

Downgoat

oh

quartata

I think I already see your problem though

Downgoat

parms="-game tf -strictportbind -ip ${ip} -port ${port} +clientport ${clientport} +map ${startmap} +tv_port ${sourcetvport} +sv_setsteamaccount ${gslt} +servercfgfile ${servercfg} -maxplayers ${maxplayers} -autoupdate -steam_dir steamcmd/ -steamcmd_script steamcmd/tf2.txt -condump -replay"

those args

@quartata pls tell

quartata

Can I see your replay.cfg

Downgoat

02:24

// tf/cfg/replay.cfg

//
// To enable replay, modify this file, and either replay_local_http.cfg or replay_ftp.cfg (see below), then
// run your server with something like:
//
//    srcds -game tf -console -replay
//
// The replay system will do a sanity check at startup to help you debug any issues.
//
// For a full overview on getting setup, view the "Replay Overview for Server Operators & FAQ" here:
//
//  forums.steampowered.com/forums/showthread.php?t=1882475
//

// Enable replay!
replay_enable "1"

quartata

Move replay_name line into replay.cfg below replay_fileserver_protocol, move exec replay.cfg to the bottom of server.cfg, get rid of +tv_port, comment out everything below (including) sp plugin load tf2goat

Try that first.

Downgoat

that shouldn't fix anything tho

beacuse it worked before

idk it just bork oneday

quartata

oh and don't comment out exec replay.cfg

Downgoat

wait it is?

quartata

@Downgoat Everything below sp plugin tf2goat is all new

Downgoat

02:29

I don't see relay_name?

quartata

replay_name

Before you start show me your server and replay cfgs again

@Downgoat

Downgoat

that to

quartata

I'm staring at it. It's in server.cfg

Downgoat

@quartata comment everything below what?

quartata

sp plugin load tf2goat, not including exec replay.cfg

Downgoat

02:36

restart now?

quartata

Show me both cfgs

Downgoat

ok

lemme get it

GODDAMMIT ITS STILL BORKED

quartata

dude

I didn't mean start it yet sheesh

Downgoat

exec banned_user.cfg
exec banned_ip.cfg
writeid
writeip

// Hostname for server.
hostname "PPCG Server"

// RCON - remote console password.
rcon_password "tapSecrit1234"

// Server password - for private servers.
sv_password "blamehooves"

// Server Logging
log on
sv_logbans 1
sv_logecho 1
sv_logfile 1
sv_log_onefile 0

tf_weapon_criticals 0
tf_use_fixed_weaponspreads 1

sv_pausable 1
sv_pure 0
sv_region 1
sv_timeout 100

mp_autoteambalance 0
mp_chattime 10
mp_idledealmethod 2
mp_idlemaxtime 10

// tf/cfg/replay.cfg

//
// To enable replay, modify this file, and either replay_local_http.cfg or replay_ftp.cfg (see below), then
// run your server with something like:
//
//    srcds -game tf -console -replay
//
// The replay system will do a sanity check at startup to help you debug any issues.
//
// For a full overview on getting setup, view the "Replay Overview for Server Operators & FAQ" here:
//
//  forums.steampowered.com/forums/showthread.php?t=1882475
//

// Enable replay!
replay_enable "1"

quartata

ls tf/cfg

Downgoat

02:39

.                                mapcycle_featured_maps.txt            mapcycle_quickplay_payloadrace.txt  server_casual.cfg                                            server_matchmaking_base.cfg
..                               mapcycle_halloween_event_247.txt      mapcycle_quickplay_payload.txt      server_casual_max_rounds_win_conditions.cfg                  server_mvm.cfg
360controller.cfg                mapcycle_halloween.txt                mapcycle.txt                        server_casual_max_rounds_win_conditions_mannpower.cfg        sfm_defaultanimationgroups.txt

quartata

ls tf/cfg/*.cfg

sorry

Downgoat

serverfiles/tf/cfg/360controller.cfg        serverfiles/tf/cfg/server_247_mannpower.cfg                                     serverfiles/tf/cfg/server_competitive_rounds_win_conditions_high_skill.cfg
serverfiles/tf/cfg/360controller-linux.cfg  serverfiles/tf/cfg/server_247_rounds.cfg                                        serverfiles/tf/cfg/server_competitive_stopwatch_win_conditions.cfg
serverfiles/tf/cfg/banned_ip.cfg            serverfiles/tf/cfg/server_bootcamp.cfg                                          serverfiles/tf/cfg/server_competitive_stopwatch_win_conditions_high_skill.cfg

-su: sorry: command not found

:/

quartata

dafuq is in tf2-server.cfg

psst that's your cue to show me what's in it

Downgoat

that is server.cfg

quartata

?

Downgoat

02:45

what confusing

quartata

Nevermind.

which watch

@Downgoat

@Downgoat I wouldn't get too discouraged FWIW. I've still got quite a couple of things left to do (and one big trump card)

Downgoat

03:04

$ which watch
/usr/bin/watch

quartata

@Downgoat Can you open up two ssh sessions

Downgoat

ok?

should i just reinstall server

quartata

Not yet. I'll get to that eventually but I want you to do it in a specific way

Start top in one

Then <command to start TF server> &; touch tf/console.log; less +F tf/console.log in the other.Watch top and the second you see the memory usage start to peak note what's showing up in less and what just happened

@Downgoat

@Downgoat Also check for any orphaned processes in top before you start

Eᴀsᴛᴇʀʟʏ Iʀᴋ

03:48

how goes it?

quartata

Well it would be going fine except the goat left so

Eᴀsᴛᴇʀʟʏ Iʀᴋ

ouch

quartata

@Downgoat I guess I'll just cut to the chase; create a new directory and git init it. Then install the server into it with Steamcmd, commit, restart droplet and run it with no modifications. Then ping me

I'd rather continue debugging but I'm sick of spreading this out over days

Eᴀsᴛᴇʀʟʏ Iʀᴋ

let's just only install things we can test amply

tf2goat and that's about it

and admin cheats preferably

quartata

It has nothing to do with the plugins.

Eᴀsᴛᴇʀʟʏ Iʀᴋ

03:57

what's wrong then? what's your best guess?

quartata

10% chance it's replays, 90% chance it's DO.

We'll find out the hard way I guess

Eᴀsᴛᴇʀʟʏ Iʀᴋ

17:24

@quartata DO?

quartata

DigitalOcean

Eᴀsᴛᴇʀʟʏ Iʀᴋ

oic

quartata

17:50

It feels so weird to see your cat without a hat

Well, I mean, not without a hat but

Downgoat

18:22

@quartata ok

@quartata okay doing

quartata

Having it in a git repo means we can add things and then revert

And also do backups by setting up a remote perhaps

Downgoat

yeah

but my secrit rcon passwords and all you'll see?

quartata

Oh I mean a private remote

not github obviously

Downgoat

still you can still see secrit info, no?

I guess I could .gitignore them

quartata

I mean something only you would have access to

Like your local PC

Downgoat

18:29

./steamcmd.sh: line 38: 26676 Killed                  $DEBUGGER "$STEAMEXE" "$@"

goddammit

quartata

You could keep it as just a regular local git repo on the server though. It was just a thought

@Downgoat OK that's DO

Has to be.

Check your quotas and stuff

Downgoat

oh I thought you meant like I push to private GH repo and you can do change and I just git pull entire server

quartata

Oh and free Run free

Downgoat

$ free
             total       used       free     shared    buffers     cached
Mem:        506308     500488       5820      34772       2616     164540
-/+ buffers/cache:     333332     172976
Swap:            0          0          0

quartata

Yeah. I thought as much.

DO is doing something.

Downgoat

18:32

actually i had old server running

I killed it

quartata

Actually do free -h

@Downgoat Wait it was running without dying?

@Downgoat Wait stop steamcmd

Downgoat

wait wat why

quartata

please

it'll save progress

free -h

@Downgoat please

Downgoat

Should I kill th einstallation?

quartata

YES

Downgoat

18:41

$ free -h
             total       used       free     shared    buffers     cached
Mem:          494M       425M        69M        31M        82M       158M
-/+ buffers/cache:       184M       309M
Swap:           0B         0B         0B

ok done

quartata

Read those numbers for second

Downgoat

> 309M

doesn't seem that bad

WAIT WHAT HAPPEN TO SWAP

quartata

You have 500MB of RAM. Something is wrong.

425MB is being used.

top

Downgoat

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
22456 mysql     20   0  623996  43052      0 S  0.3  8.5   0:48.51 mysqld
30349 vihan     20   0   23540   2924   2476 R  0.3  0.6   0:00.01 top
    1 root      20   0   28784   2688    832 S  0.0  0.5   0:12.26 systemd

yup

wait

but mysql only use 8.5%

quartata

No wonder it's crashing. You can't run jackshit with 50MB of RAM.

Move the plugins back into tf/addons

metamod*, sourcemod*, source-python*

uncomment all that stuff I told you to comment out in server.cfg

Then let's take a look at ps -ef. (Also is this droplet supposed to have only 500M)

@Downgoat

Downgoat

18:46

UID        PID  PPID  C STIME TTY          TIME CMD
root         1     0  0 Dec17 ?        00:00:12 /sbin/init
root         2     0  0 Dec17 ?        00:00:00 [kthreadd]
root         3     2  0 Dec17 ?        00:00:25 [ksoftirqd/0]
root         5     2  0 Dec17 ?        00:00:00 [kworker/0:0H]
root         7     2  0 Dec17 ?        00:00:37 [rcu_sched]
root         8     2  0 Dec17 ?        00:00:00 [rcu_bh]
root         9     2  0 Dec17 ?        00:00:00 [migration/0]
root        10     2  0 Dec17 ?        00:00:04 [watchdog/0]

quartata

Apache eh?

Downgoat

I added 1GB swap

should I try now

quartata

Shut down Apache and MySQL (temporarily) and let's see what free -h says

@Downgoat Swap won't really help.

too slow

Downgoat

@quartata >_> if I do that wordpress will not behave when I turn back on

I could upgrade to a 1GB of RAM droplet

quartata

also move all thse plugins in disabled/ back into sourcemod/plugins

Downgoat

18:49

old-su: cannot create temp file for here-document: No space left on device
-su: cannot create temp file for here-document: No space left on device

halp wat

quartata

@Downgoat du -h /. You probably gave swap too much

Actually not du. df

df -h

Downgoat

Filesystem      Size  Used Avail Use% Mounted on
/dev/vda1        20G   20G     0 100% /

pls halp I did a stupid

-rw-------  1 root root 2147483648 Oct 10 23:43 swapfile

quartata

Sheesh.

Downgoat

-rw-------  1 root root 1000M Dec 22 18:45 swap

only 100-MB tho

wait wat oops

rm: cannot remove ‘/swap’: Operation not permitted

quartata

how has anything even been working

Downgoat

18:52

halp I chmodded 600 and it's owned by root

quartata

You don't delete swap that will crash the kernel

Downgoat

how to fix then pls halp

tf2server@vihan:~$ ls -alh /
total 3.0G
drwxr-xr-x 23 root root  4.0K Dec 22 18:45 .
drwxr-xr-x 23 root root  4.0K Dec 22 18:45 ..
drwxrwxr-x  2 root root  4.0K Dec  3 20:16 bin
drwxr-xr-x  3 root root  4.0K Dec  3 20:17 boot
drwxr-xr-x 17 root root  2.9K Dec 17 16:49 dev
drwxr-xr-x 99 root root  4.0K Dec  3 20:18 etc
drwxr-xr-x  4 root root  4.0K Nov 11 20:48 home
lrwxrwxrwx  1 root root    31 Oct  5 15:15 initrd.img -> /boot/initrd.img-3.16.0-4-amd64
drwxr-xr-x 17 root root  4.0K Nov 11 20:51 lib

quartata

Just restart the damn thing and modify the swap however you did in the first place

Downgoat

> total 3.0G

@quartata I just used dd to create 1GB file and did swapon thing

what is droplet cannot boot up beacuse bork out of spcae

quartata

Oh my head...

Um. OK. one second

Can you not use swapoff

Do watch -n1 df -h

@Downgoat

quartata

19:16

@Downgoat Hello?

Downgoat

19:26

hai

ok

Every 1.0s: df -h                                                                                                                                                                   Thu Dec 22 19:27:08 2016

Filesystem      Size  Used Avail Use% Mounted on
/dev/vda1        20G   20G     0 100% /
udev             10M     0   10M   0% /dev
tmpfs            99M  360K   99M   1% /run
tmpfs           248M     0  248M   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           248M     0  248M   0% /sys/fs/cgroup

stil same bork

@quartata ^^

here is space breakdown:

1.1G	/var/www
2.6G	/var
3.0G	/home/tf2server/new_server/serverfiles/steamapps/downloading/232250/tf/maps
4.0G	/home/tf2server/new_server/serverfiles/steamapps/downloading/232250/tf
4.6G	/home/tf2server/new_server/serverfiles/steamapps/downloading/232250
4.6G	/home/tf2server/new_server/serverfiles/steamapps/downloading
4.6G	/home/tf2server/new_server/serverfiles/steamapps
4.6G	/home/tf2server/new_server/serverfiles
4.6G	/home/tf2server/new_server
4.2G	/home/tf2server/old_server/serverfiles/tf/maps

ok saved 13GB

Holy shit tho tf2 server use lots of space

0/10

tf2 server space breakdown:

1.3M	new_server/serverfiles/steamapps/downloading/232250/platform/resource
1.4M	new_server/serverfiles/steamapps/downloading/232250/platform/admin
1.5M	new_server/serverfiles/steamapps/downloading/232250/platform/servers
3.0G	new_server/serverfiles/steamapps/downloading/232250/tf/maps
3.1M	new_server/lgsm/tmp
3.2M	new_server/lgsm
3.3M	new_server/serverfiles/steamapps/downloading/232250/tf/scripts/items
3.4M	new_server/serverfiles/steamapps/downloading/232250/tf/scripts
4.0G	new_server/serverfiles/steamapps/downloading/232250/tf

shit shit shit

i accedintally delete server conflig

damn it

@quartata question: can you just like create server files. send it to me in zip and I isntall?

I fiexd RAM and disk problem tho

@quartata okay uber-bork but the entire tf/ directory got somehow destroyed and everything has been delete

so well shit

quartata

20:44

@Downgoat Jeez.

I'll see what I can do I guess.

Downgoat

btw I'm using SGSM

quartata

Yeah the server is ~10GB. That's why I'm amazed this has been running at all

I don't want to send you assets but I can send addons/ and cfg/.

In the mean time reinstall and just get a clean install up.

Downgoat

ok

quartata

By the way, did you really delete /home

And that new breakdown is small only because it didn't finish downloading by the way

Downgoat

21:16

@EᴀsᴛᴇʀʟʏIʀᴋ @quartata pls halp i need GSLT for sevrer: steamcommunity.com/dev/managegameservers

pls

Eᴀsᴛᴇʀʟʏ Iʀᴋ

22:02

@Downgoat I have that

Downgoat

@EᴀsᴛᴇʀʟʏIʀᴋ pls send

Eᴀsᴛᴇʀʟʏ Iʀᴋ

no quotes obv

@Downgoat let me know when you got it

typed in and stuff

@Downgoat?

goat pls

Downgoat

sorry gimme sec

actually i got it

tyvvvvvm

Eᴀsᴛᴇʀʟʏ Iʀᴋ

k

@Downgoat talk here

Downgoat

good poin

okay try now

Eᴀsᴛᴇʀʟʏ Iʀᴋ

22:12

k

nupe

@Downgoat

Downgoat

@EᴀsᴛᴇʀʟʏIʀᴋ it bork?

Eᴀsᴛᴇʀʟʏ Iʀᴋ

thanks @Juke

@Downgoat ye

Downgoat

is that yes it bork or no it unbork

Eᴀsᴛᴇʀʟʏ Iʀᴋ

"connection failed after 4 retries"

Downgoat

> Client "EasterlyIrk" connected (172.249.47.98:27005).

Eᴀsᴛᴇʀʟʏ Iʀᴋ

22:14

I AM IN

Downgoat

lies

eivl cat spek eivl lie

:D

Eᴀsᴛᴇʀʟʏ Iʀᴋ

it failed once tried again and 3 time worked >_< lel

Downgoat

haha

@quartata I got it unbork

Eᴀsᴛᴇʀʟʏ Iʀᴋ

ok I gtg brb

@Downgoat will test more in a bit

add sourcemod and tf2goat back if you haven't already pls

and leave it alone then >_<

Downgoat

bai

TuxCopter

22:25

Is the server up?

Downgoat

yea

TuxCopter

The server don't need a password?

Eᴀsᴛᴇʀʟʏ Iʀᴋ

22:44

back

@TuxCopter @Downgoat fix this

Downgoat

ono is bork

oh oops

brb fixing all problem

restarting server

Eᴀsᴛᴇʀʟʏ Iʀᴋ

k

Downgoat

ok tap secrit password is blamehooves

Eᴀsᴛᴇʀʟʏ Iʀᴋ

lel

tap?

Downgoat

tap = top

Eᴀsᴛᴇʀʟʏ Iʀᴋ

22:47

oic

Currently accepting donations of boxtrot taunts, contact Riker on PPCG (orrikersan on steam) for more information

2

Downgoat

what is boxtrot taunt

Eᴀsᴛᴇʀʟʏ Iʀᴋ

it's a looping taunt for spy, he can crawl around in a box

it costs like 1.50

google it

Downgoat

connect vihan.org; password blamehooves

@EᴀsᴛᴇʀʟʏIʀᴋ oh

sorry then, I only have hay bales :P

Eᴀsᴛᴇʀʟʏ Iʀᴋ

lel

Downgoat

ok will install stuffs now

@EᴀsᴛᴇʀʟʏIʀᴋ if i give u root pls promise to do no eivl

Eᴀsᴛᴇʀʟʏ Iʀᴋ

22:51

I won't

don't worry

@Downgoat does kickign people who don't like cats or goats count as evil

Downgoat

@EᴀsᴛᴇʀʟʏIʀᴋ no

that is opposite of evil :D

Eᴀsᴛᴇʀʟʏ Iʀᴋ

:D

TuxCopter

Nobody want to play?

Eᴀsᴛᴇʀʟʏ Iʀᴋ

I can't rn, maybe in a bit

Downgoat

im busy setting up server rn

Eᴀsᴛᴇʀʟʏ Iʀᴋ

22:54

@Downgoat seriously, big thanks for being the server hoster

it's a lot of fun

Downgoat

:D

np

you can show thanks by denouncing chevon :D

@EᴀsᴛᴇʀʟʏIʀᴋ steam id?

@TuxCopter do u want admin? I can give to you but u must promise to not to do eivl

TuxCopter

yes

I promise I will not use my admin superpowers for evil

Downgoat

Do you herby solemnly swear that you will faithfully execute the tasks of the PPCG TF2 server admin and to the best of your best of your ability, preserve, protect, and defend the server.cfg?

TuxCopter

Yes

Transcript for

PPCG TF2 Server - Shut down now