Nothing to worry about. ipfw is only used for traffic shaping in SmallWall - you probably enabled and later disabled the traffic shaper (the module is only loaded on demand). The real packet filtering is done with ipfilter, which is compiled into the kernel and cannot be unloaded.