Philadelphia Session @ KKIO'14

Recent Polish achievements in Software Engineering

Session chairs - Lech Madeyski (Wrocław University of Technology) and Mirek Ochodek (Poznań University of Technology)

Co-Founders of the "Philadelfia Sessions"

The first "Philadelphia session" was organized and chaired by Prof. Jerzy Nawrocki and Prof. Zbigniew Huzar at the KKIO'13 Software Engienering Conference.

halfPageHeight halfPageHeight

Aims of the "Philadelphia session"

  1. To present important, recent achievements of Polish researchers in software engineering (published by SE journals indexed by Thomson Reuters).

  2. To stimulate high-quality research, collaboration and discussion on research challenges in software engineering.

Is such a session needed?

The answer would be NO if the Polish contribution in software engineering would be impressive.

Therefore, we decided to assess (in comparison to other European countries) the contribition of authors with Polish affiliations to leading SE journals since 2010.

Which software engineering journals should be selected to assess contribution?

  • Glass was the first who two decades ago published an assessment of systems and software engineering scholars and institutions (Glass (1994)). The set of 6 journals selected arbitrary by Glass included: IEEE Transactions on Software Engineering (TSE), ACM Transactions on Software Engineering and Methodologies (TOSEM), IEEE Software (SW), Information and Software Technology (IST), Journal of Systems and Software (JSS), and Software: Practice and Experience (SPE).

  • (Wong et al. (2009); Wong et al. (2011)) have assessed scholars and institutions extending this set of journals by the Empirical Software Engineering (EMSE) journal to emphasize the importance of strong empirical component.

  • A complementary series of analyses of the most cited articles in the software engineering journals has been published by Wohlin. The most recent of analyses was published in 2009 on a basis of 18 software engineering journals (Wohlin (2009)).

How we selected journals to assess contribution?

  • We decided to include in the analyzed set of journals all of the software engineering journals analyzed by Wong et al. (Wong et al. (2009); Wong et al. (2011)) as well as Wohlin (Wohlin (2009)), even if they changed their names.

  • Then from the created superset of journals we excluded journals which are discontinued or journals without an assigned impact factor in 2013.

  • Our set of journals based on the inclusion decisions of the renowned authors of previous analyses. However, the created set of journals is by no means complete and can be extended even further.

  • Our arbitrary decision was to extend the set of journals by adding the Software and Systems Modeling journal, which is strictly SE journal with an assigned impact factor.

  • There is also a wide range of computer science journals (e.g., Computing and Informatics, Cybernetics and Systems) which could be included (but it would require an extreme effort) on a paper by paper basis as some of them may be related to software engineering.

The final set of 16 analyzed SE journals

ACM Transactions on Software Engineering and Methodology (TOSEM)
Automated Software Engineering (ASE)
Empirical Software Engineering (EMSE)
IET Software (IETSW)
IEEE Software (SW)
IEEE Transactions on Software Engineering (TSE)
Information and Software Technology (IST)
International Journal of Software Engineering and Knowledge Engineering (IJSEKE)
Journal of Software: Evolution and Process (JSEP)
Journal of Software Maintenance and Evolution: Research and Practice (JSME)
Requirements Engineering Journal (REJ)
Software and Systems Modeling (SoSyM)
Software Quality Journal (SQJ)
Software Testing, Verification and Reliability (STVR)
Software: Practice and Experience (SPE)
Journal of Systems and Software (JSS)

Search process

All of these 16 journals are indexed by Scopus, which provides an excellent search interface including ability to construct advanced search strings.

An example of the search string we used to constrain our search to the papers by authors with Polish affiliations published since 2010 in the analyzed set of journals is presented below:

(ISSN(1049331X) OR ISSN(09288910) OR ISSN(13823256) OR ISSN(17518806) OR
ISSN(07407459) OR ISSN(00985589) OR ISSN(09505849) OR ISSN(02181940) OR
ISSN(1532060X) OR ISSN(09473602) OR ISSN(20477481) OR ISSN(09639314) OR
ISSN(09600833) OR ISSN(00380644) OR ISSN(01641212) OR ISSN(16191366)) AND
AFFIL(poland) AND (PUBYEAR > 2009)

We may easily restrict the search process to other countries (e.g., ' AFFIL(germany)') or just remove the restriction.

Search results

The search performed using Scopus on September 14, 2014 returned:

  • 4591 document results in total,
  • 973 document results by authors from United States
  • 469 document results by authors from UK,
  • 418 document results by authors from Spain,
  • 390 document results by authors from Germany,
  • 340 document results by authors from Italy,
  • (other countries...)
  • 35 document results by authors from Portugal,
  • 28 document results by authors with Polish affiliations.

Contribution of European countries to SE journals

plot of chunk unnamed-chunk-2

Coming back to the posed question

How impressive is the Polish contribution to leading SE journals?

  1. extremely weak
  2. there seems to be a SPACE for improvement
  3. close to impressive
  4. impressive indeed

Being an optimist, I would say that there seems to be a SPACE for improvement ;) and we need to put a lot of effort to be at the vanguard of Europe.

The "Philadelfia Session" could be one of effective and sustainable levers for our growth.

Being an optimist, I would say that there seems to be a SPACE for improvement ;)

The "Philadelphia sessions"

  • 2013:

    • Lech Madeyski: Mutation Testing – selected issues, on a basis of papers published in IEEE Transactions on Software Engienering (2014) and IET Software (2010) journals.
    • Mirek Ochodek: Effort estimation based on use cases, on a basis of papers published in Information and Software Technology (2011) and Computing and Informatics (2010)
  • 2014:

    • Jakub Jurkiewicz/Jerzy Nawrocki: Identification of events in use cases.
    • Piotr Kosiuczenko: Solving the invariability problem in OCL.
    • Cezary Orłowski: Model of a maturity capsule in managing IT projects.
    • Łukasz Radliński: Predicting the Flow of Defect Correction Effort using a Bayesian Network Model

Credits

  • Elsevier for Scopus.
  • Yihui Xie for knitr.
  • Ramnath Vaidyanathan for slidify.
  • Ramnath Vaidyanathan, Kenton Russel, Thomas Reinholdsson for rCharts.
  • Andy South for rworldmap
  • Joe Cheng for Shiny.
  • Jeffrey Horner and RStudio for R Markdown.
  • Hadley Wickham for several R packages.
  • Authors of the JS libraries I have used (especially Google's io2012).

References

[1] R. L. Glass. "An Assessment of Systems and Software Engineering Scholars and Institutions". In: Journal of Systems and Software 27.1 (Oct. 1994), pp. 63-67. ISSN: 0164-1212. DOI: 10.1016/0164-1212(94)90115-5. .

[2] C. Wohlin. "An Analysis of the Most Cited Articles in Software Engineering Journals - 2002". In: Information and Software Technology 51.1 (Jan. 2009), pp. 2-6. ISSN: 0950-5849. DOI: 10.1016/j.infsof.2008.09.012. .

[3] W. E. Wong, T. H. Tse, R. L. Glass, et al. "Controversy Corner: An Assessment of Systems and Software Engineering Scholars and Institutions (2002-2006)". In: Journal of Systems and Software 82.8 (Aug. 2009), pp. 1370-1373. ISSN: 0164-1212. DOI: 10.1016/j.jss.2009.06.018. .

[4] W. E. Wong, T. Tse, R. L. Glass, et al. "An assessment of systems and software engineering scholars and institutions (2003-2007 and 2004-2008)". In: Journal of Systems and Software 84.1 (2011). Information Networking and Software Services, pp. 162-168. ISSN: 0164-1212. DOI: http://dx.doi.org/10.1016/j.jss.2010.09.036. .

The "Philadelphia session" in 2013 (in detail):

  1. Lech Madeyski: Mutation Testing – selected issues, on a basis on the following articles:

    • L. Madeyski, W. Orzeszyna, R. Torkar, M. Józala, “Overcoming the Equivalent Mutant Problem: A Systematic Literature Review and a Comparative Experiment of Second Order Mutation”, IEEE Transactions on Software Engineering, 40 (1), pp. 23-42, 2014.
    • L. Madeyski, N. Radyk, “Judy – A Mutation Testing Tool for Java”, IET Software, Volume 4, Issue 1, Pages 32 – 42, 2010.
  2. Mirosław Ochodek: Effort estimation based on use cases, on a basis of the following articles:

    • M. Ochodek, J. Nawrocki, K. Kwarciak: Simplifying effort estimation based on Use Case Points, Information and Software Technology, 53(3):200–213, 2011.
    • M. Ochodek, B. Alchimowicz, J. Jurkiewicz, J. Nawrocki: Improving the reliability of transaction identification in use cases, Information and Software Technology, 53(8):885–897, 2011.
    • B. Alchimowicz, J. Jurkiewicz, M. Ochodek, and J. Nawrocki. Building Benchmarks for Use Cases. Computing and Informatics, 29(1):27–44, 2010.