OSDC.TW 2012 - The ecosystems of PHP and Perl

The Ecosystems of
Perl & PHP
林佑安 (c9s)
Saturday, April 14, 12

View Slide

Speaker
• 林佑安 [email protected], [email protected]
• Web Developer
• CPAN author for ~30 distributions.
• 187 repos/projects on GitHub.
• Perl programming since 2008.
• PHP programming since 2011.

View Slide

我本來是個 XXX Developer

View Slide

直到我膝蓋中了⼀一箭...

View Slide

但是

View Slide

今天不是要來打臉的

View Slide

Let’s take a look at PHP from Perl.
從 Perl 的角度來看 PHP

View Slide

Language

View Slide

PHP

View Slide

Rasmus Lerdorf
於 1995 年發明 PHP
Danish Programmer

View Slide

PHP3
Zeev Suraski Andi Gutmans
Zend Technologies

View Slide

A general-purpose
server-side scripting language
伺服端的腳本語言

View Slide

A general-purpose
server-side scripting language
伺服端的腳本樣板語言

View Slide

動態產生網頁內容

View Slide

PHP
• 從 C 語言 CGI 函式庫發展
• 以早期 Perl 的部分語法為雛形
• 2002 年 PHP 4.3.0 新增 CLI SAPI
• 2004 年 PHP 5.0.0 新增類 Java 的物件模
型
• 2012 年 PHP 5.4 引進 Trait, 內建 Http
Server, 大量改善 Zend Engine 效能

View Slide

Perl

View Slide

Larry Wall
程式員, 系統管理員,
語言學家, 作家
1987 年發明 Perl

View Slide

There's More Than One Way To Do It.
不只⼀一種方法來做⼀一件事情

View Slide

為了「...」而設計的的 Perl
“When Larry designed the ﬁrst Perl, he was a
sysadmin, Perl was designed for sysadmins.
When Perl5 was created, Larry was a programmer.
Perl5 is designed for programming.
It is a programming language.
Larry is now a language designer, Perl6 is a language
for language design.” - Jesse Vincent
from gugod http://gugod.org/2011/11/perl-for-dot-dot-dot/

View Slide

Perl: 以簡馭繁的中心思想
$list = array_map(function($item) {
return $item . 'bar';
}, array_filter( $list, function($item) {
return preg_match('#^foo#',$item);
});

View Slide

Perl: 以簡馭繁的中心思想
$list = array_map(function($item) {
return $item . 'bar';
}, array_filter( $list, function($item) {
return preg_match('#^foo#',$item);
});
# perl
@list = map { $_ . 'bar' } grep /^foo/, @list;

View Slide

Perl
• 從 Unix scripting language 出發
• 借取了 C, sed, awk, shell 等特性
• 1990 年時大量 CGI 程式使用 Perl 寫作
• 1994 年 Perl5 加入 OOP
• 5.8.0 版時加入了 Unicode 支援
• 2006 年第⼀一版 Moose 模組 (後現代物件系統) - 可改
善 Perl 的物件導向功能，包含 Trait, Lazy Attributes 等
功能
• 2009 年 Plack 模組的出現使得 Perl 於 Web 開發上效
能、便利性更是大大提昇。

View Slide

小結
• PHP 在語言設計上，除了 server-side scripting
language 外並無明顯的中心思想
• Perl 以命令列發展至 Web，而 PHP 是後來才加
入了命令列支援。
• 類別自動載入機制，是在 PHP 5.x 版後才加
入，因此多數 PHP 模組載入方式、路徑格式差
異相當大，也使得各系統間元件相當難重新使
用 (reuse)

View Slide

Package System

View Slide

PHP

View Slide

PEAR
http://pear.php.net

View Slide

PECL
http://pecl.php.net

View Slide

PHP ecosystem
• since 1999-11-21

View Slide

PHP ecosystem
• since 1999-11-21
• 586 packages on pear.php.net

View Slide

PHP ecosystem
• since 1999-11-21
• 280 extensions on pecl.php.net

View Slide

PHP ecosystem
• since 1999-11-21
• 19 packages on pear2.php.net

View Slide

PHP ecosystem
• since 1999-11-21
• 840 packages on packagist.org

View Slide

PHP ecosystem
• since 1999-11-21
• no package tester.

View Slide

PHP ecosystem
• since 1999-11-21
• no package tester & reports
• 2 mirror sites (us, de)

View Slide

PHP ecosystem
• Use `pear` and `pyrus.phar` to install PEAR
packages (system-wide).
• Pirum, PEAR channel builder.
• MiniPear, PEAR channel mirror tool.

View Slide

Perl

View Slide

CPAN
http://search.cpan.org

View Slide

CPAN Tester: test matrix
http://cpantesters.org

View Slide

MetaCPAN
https://metacpan.org/

View Slide

CPAN Dependencies

View Slide

CPAN
• Since October 1995

View Slide

CPAN
• 77800 Uploads

View Slide

CPAN
• 77800 Uploads
• 24637 Distributions

View Slide

CPAN
• 77800 Uploads
• 105724 Modules

View Slide

CPAN
• 77800 Uploads
• 105724 Modules
• 9627 Authors

View Slide

CPAN
• 77800 Uploads
• 105724 Modules
• 9627 Authors
• 245 mirror sites

View Slide

CPAN
• 77800 Uploads
• 105724 Modules
• 9627 Authors
• Issue Tracker (RT)

View Slide

CPAN
• 77800 Uploads
• 105724 Modules
• 9627 Authors
• CPAN Tester since
1999

View Slide

CPAN
• 77800 Uploads
• 105724 Modules
• 9627 Authors
• CPAN Tester since
1999
• MetaCPAN

View Slide

1000+ distribution
uploads per month.
From CPAN Tester statistics
http://stats.cpantesters.org/trends.html

View Slide

250+ new distribution
uploads per month
From CPAN Tester statistics
http://stats.cpantesters.org/trends.html

View Slide

Command-line Tools
• cpan (Original CPAN shell)
• cpanp (CPANPLUS)
• cpanm (CPAN Minus)
• carton (Bundler)
• pinto (CPAN package repository tool)
• CPAN::Mini (CPAN Mirror Tool)

View Slide

對此, PHP 表示...

View Slide


View Slide

為何有如此巨大差異 ?
Why such a big difference ?

View Slide

三個問題
Three problems

View Slide

Problem #1
PEAR 繁瑣的上傳程序

View Slide

如何上傳 CPAN
package ?

View Slide

上傳 CPAN Package: 3 Steps
• Register a PAUSE
account
http://pause.perl.org/

View Slide

account
• Conﬁrm your
email

View Slide

account
• Conﬁrm your
email
• Upload!

View Slide

CPAN Shipping tools
• ShipIt
• CPAN::Uploader

View Slide

CPAN Shipping tools
• ShipIt
• CPAN::Uploader
⼀一鍵搞定版本釋出

View Slide

那麼如何上傳
PEAR Package ?

View Slide

Upload PEAR package
• Register a PEAR account

View Slide

Upload PEAR package
• Conﬁrm Email

View Slide

Upload PEAR package
• Conﬁrm Email
• Are we done yet ?

View Slide

And not yet
• Join Mailing List

View Slide

And not yet
• Use PHP_CodeSniffer to
verify your standard
coding convention.

View Slide

And not yet
coding convention.
• Create a proposal draft

View Slide

And not yet
coding convention.
• Proposal stage, discuss &
discuss ...

View Slide

And not yet
coding convention.
discuss ...
• Waiting for votes

View Slide

And not yet
coding convention.
discuss ...
• Waiting for votes
• Proposal ﬁnished

View Slide

然後呢？等 ...

View Slide

等你等到海枯石爛~

View Slide

You don’t even suffer such
process on GitHub!

View Slide

Problem #2
各自為政的套件庫

View Slide

CPAN
PHP Packages are not centralized like CPAN

View Slide

PEAR
Most packages and libraries are not on PEAR,
they have their own channels.

View Slide

PHPUnit
PEAR
Symfony
Zend
Pyrus
phpmd
phpspec
phrozn
ezComponents
Drupal Packages
WordPress
Composer
pearfarm
OpenPEAR

View Slide

And no mirrors

View Slide

PEAR

View Slide

It makes channel list longer and longer

View Slide

套件難以搜尋
it’s hard to search packages

View Slide

PEAR package hosting
pearfarm.org
openpear.org

View Slide

Problem #3
The Hard Package
Meta ﬁle

View Slide

use inc::Module::Install;
name 'Plack';
all_from 'lib/Plack.pm';
readme_from 'lib/Plack.pm';
requires 'LWP::UserAgent', 5.814;
requires 'HTTP::Message', 5.814;
requires 'URI', 1.36;
tests 't/*.t t/*/*.t';
author_tests 'xt';
install_share 'share';
install_script 'scripts/plackup';
auto_install;
auto_set_repository;
resources
homepage => "http://plackperl.org",
bugtracker => "https://github.com/
miyagawa/plack/issues";
WriteAll;
This is how we do in Perl

View Slide

This is how we do in Perl
$ perl Makeﬁle.PL

View Slide

• Simple
Makeﬁle.PL

View Slide

• Simple
• Clean
Makeﬁle.PL

View Slide

• Simple
• Clean
• Flexible
Makeﬁle.PL

View Slide

• Simple
• Clean
• Flexible
• Pure Perl
Makeﬁle.PL

View Slide

How to build a PEAR
package ?

View Slide

package.xml

View Slide

規格書第⼀一
看完再來 Build package 吧!

View Slide

package.xml

gearman
pecl.php.net
PHP wrapper to libgearman
This extension uses libgearman library to provide API for communicating
with gearmand, and writing clients and workers.

James M. Luedke
jluedke
[email protected]
no

Herman J. Radtke III
hradtke
[email protected]
yes

2011-12-05
16:41:40

1.0.1
1.0.1

stable
stable


View Slide

package.xml
PHP

- Fixed PECL Bug #60438 (wrong version number in php_gearman.h)


View Slide

package.xml

5.1.0
6.0.0
6.0.0

1.4.0b1

gearman

stable
stable

1.0.1
1.0.1

2011-12-05

- Fixed PECL Bug #60438 (wrong version number in php_gearman.h)

.... cut ....


View Slide

你暈了嗎

View Slide

這應該是要透過工具產生才
對吧 ?

View Slide

Build tool
• PEAR_PackageFileManager_Cli
• Pyrus make, generate-pear2 command

View Slide

不過...

View Slide

Unfortunately
• 既有的 package ﬁle builder 幾乎都無法正
常運作 (不斷丟出 Exceptions)

View Slide

Unfortunately
• 無清楚的文件

View Slide

Unfortunately
• 操作繁瑣，必須⼀一行行依照詢問輸入

View Slide

Unfortunately
• XML Tag 順序不對，就無法建置

View Slide

Unfortunately
• XML Tag 順序不對，就無法建置
• 雖然可以用 composer ，但卻是另外的生
態系統。

View Slide


View Slide

小結

View Slide

CPAN
• 自由且開放: 任何人都可以快速發佈自己
的作品
• 多樣性: ⼀一種目的多種原型、實作，開發
者能有更多的選擇
• 完整的測試系統: 不會隨便亂炸掉
• 以簡馭繁

View Slide

PEAR
• 封閉: 上傳套件必須審核審核再審核
• 小團體: PEAR Team < 20 人
• 無系統化測試
• 不友善的 Issue Tracker
• 設計複雜、繁瑣

View Slide

如果是如此，該如何改善呢 ?
If so, how to improve the PHP package
system ?

View Slide

The Recent tools
• Pyrus: pear2.php.net, is not opened yet. 但工具本
身仍在 Alpha stage.
• bundle install = Hack
• 仍是使用 package.xml

View Slide

The Recent tools
• Pyrus: pear2.php.net, is not opened yet. 但工具本
身仍在 Alpha stage.
• bundle install = Hack
• 仍是使用 package.xml
• Composer project by @baderman,@Seldaek
inspired from npmjs & opensuse.
• JSON meta ﬁle

View Slide

• 需要⼀一個更簡潔的套件定義檔案

View Slide

• 能夠完整產生 package.xml 達到向後相容
PEAR 套件以及 PEAR Channel

View Slide

• 能夠完整產生 package.xml 達到向後相容
PEAR 套件以及 PEAR Channel
• 需能管理套件相依性，如 Bundler

View Slide

We Can Do Better

View Slide

Onion
The PEAR packager
https://github.com/c9s/Onion

View Slide

The package.ini File
[package]
name = PackageName
desc = description
version = 1.2.0
author = “c9s ”
channel = pear.host.com

View Slide

The package.ini File
[package]
name = PackageName
desc = description
version = 1.2.0
author = “c9s ”
channel = pear.host.com
5+ lines to create a package.

View Slide

How to use it?
• Put your class ﬁles in `src/`
• Tests in `tests/`
• documentation in `doc/`

View Slide

妥善配置 Class path

View Slide

PEAR Class name rule
• Twig_Loader_Filesystem => src/Twig/Loader/
Filesystem.php
• Foo_Class_Bar => src/Foo/Class/Bar.php
• Foo => src/Foo.php

View Slide

PHP Standard Working Group

View Slide

PSR-0 classname rule
• Class\SubClass => src/Class/SubClass.php
• Foo\Bar\Zoo => src/Foo/Bar/Zoo.php

View Slide

PSR-0 classname rule
• Class\SubClass => src/Class/SubClass.php
• Foo\Bar\Zoo => src/Foo/Bar/Zoo.php
• Foo::Bar => lib/Foo/Bar.pm
• Foo => lib/Foo.pm
• Foo::Bar::Zoo => lib/Foo/Bar/Zoo.pm
Perl:

View Slide

Build PEAR package
$ curl -‐s http://install.onionphp.org/ | bash
$ vi package.ini
$ onion build # package.xml is out
$ pyrus package # build *.tgz

View Slide


View Slide

Bundle packages
[require]
php = 5.3
pearinstaller = 1.4.1
pear.phpspec.net/PHPSpec = 1.2.2beta
pear.symfony-project.com/YAML = “> 1.2”
pear.twig-project.org/Twig = “< 0.3”
pear.phpunit.de/PHPUnit = 0.0.1
PKG = http://host/to/package.tgz

View Slide

Bundle packages
$ onion bundle
# install packages into vendor/ dir.

View Slide

Bundle packages
$ tree -‐d vendor
vendor
!"" pear
#"" CLIFramework
$ !"" Command
#"" CacheKit
#"" GetOptionKit
#"" PEARX
#"" SerializerKit
#"" SymfonyComponents
$ !"" YAML
!"" Universal
#"" ClassLoader
#"" Container
#"" Event
#"" FileSystem

View Slide

建置 Autoload Script

View Slide

SPL ClassLoaders
• Symfony\ClassLoader\UniversalClassLoader
• Universal\ClassLoader\SplClassLoader
• Universal\ClassLoader\BasePathClassLoader

View Slide

SPL ClassLoader
# autoload.php
require 'Universal/ClassLoader/SplClassLoader.php';
$classLoader = new \Universal\ClassLoader\SplClassLoader(array(
'Onion' => 'src',
'CurlKit' => 'src',
'PEARX' => 'vendor/pear',
'CacheKit' => 'vendor/pear',
'CLIFramework' => 'vendor/pear',
'GetOptionKit' => 'vendor/pear',
));
$classLoader->useIncludePath(true);
$classLoader->register();

View Slide

SPL ClassLoader
# autoload.php
require 'Universal/ClassLoader/BasePathClassLoader.php';
$loader = new \Universal\ClassLoader
\BasePathClassLoader( array(
'src',
'vendor/pear'
));
$loader->useIncludePath(true);
$loader->register();

View Slide

打包㱺 Standalone executable

View Slide

To build a standalone
binary
#!/bin/bash
onion compile \
--lib src \
--lib vendor/pear \
--classloader \
--bootstrap scripts/onion.embed \
--executable \
--output onion.phar
chmod +x onion.phar

View Slide

binary
$ ./package.phar

View Slide

打包㱺 Standalone library

View Slide

binary
require 'bundle.phar';
?>

View Slide

搭配 Pirum PEAR Channel Builder
即可快速佈署、散佈公用/私用套件
Pirum PEAR
Channel
Client
Client
Client

View Slide

副產品
• PHPBrew - (perlbrew,rvm-like tool)
• CLIFramework - Command-Line app
framework.
• GetOptionKit - getopt parser.
• PEARX - PEAR channel client library.
• CurlKit - curl download tool.
• MiniPear - PEAR channel mirror tool

View Slide

Future work
• Support VCS
repository (github,
git, hg, svn)
• Lock ﬁle
• Better channel
protocol
• Autoloader
generator
• Authentication
support
• Support SSH
• Fork welcome

View Slide

Conclusion
• PHP 生態系統雖先天不足，但 PHP 開發者及市場
仍相當大。最近兩年 PSR (PHP Standard Group -
Framework Developers) 逐漸在發展共通的規範，
達到元件 reuse 的目的。
• Composer 雖是獨立的生態系統，且目前主要用
於 Symfony，但可期待未來的發展。
• 期待 PHP 生態系統能有更好的改善

View Slide

Conclusion
• PHP 生態系統雖先天不足，但 PHP 開發者及市場
仍相當大。最近兩年 PSR (PHP Standard Group -
Framework Developers) 逐漸在發展共通的規範，
達到元件 reuse 的目的。
• Composer 雖是獨立的生態系統，且目前主要用
於 Symfony，但可期待未來的發展。
• 期待 PHP 生態系統能有更好的改善 ~CoffeePHP ?

View Slide

Q & A
Thanks!
[email protected]
Twitter: http://twitter.com/c9s
GitHub: http://github.com/c9s

View Slide

OSDC.TW 2012 - The ecosystems of PHP and Perl

OSDC.TW 2012 - The ecosystems of PHP and Perl

Yo-An Lin

More Decks by Yo-An Lin

Featured

Transcript