-
- Browsing
- OGC Grid Collision, NCeSS e-Infrastructure, MoSeS
- MoSeS
- Beowulf processing check:
- Received and written result with 133 HSARDataRecords and 0 ISARDataRecords for 12UDGD0012 with fitness 7.68511911661263585851
- Sending input 91128 with ZoneCode 12UDGF0007 to 24
- Meeting with Paul and Junaid
- Junaid's MSc project work
- The purpose of this meeting was for Junaid to present this work and get feedback.
- Unfortunately we could not see a working demo at this stage, but Paul and I are in a position to provide feedback anyway.
- Problems:
- Due to a delay in the registering of MoSeS as a Service Provider (SP) for Leeds Identity Provider (IdP) a demonstration of MoSeS portal access via Shibboleth could not be given.
- Further configuration is needed so that the mod_shib module can be loaded by apache 2.2.4.
- Paul is going to help Junaid with this as it requires root authority/access.
- Main points discussed:
- Shibboleth
- PERMIS
- Junaid has been working well with John Watt.
- Paul deserves acknowledgement for the responsive work he has done in support of Junaid.
- Globus and other grid security.
- What is needed for Junaids assessment.
- Paul and Andy to draft some user feedback for Junaids assessor (Eric Atwell) to confirm that Junaid has developed/put in place some useful security infrastructure for MoSeS.
- Draft by Andy:
- An important part of Modelling and Simulation for e-Social Science (MoSeS) is the development of a portal for users of a demographic simulation and reporting system of the contemporary UK human population.
- There are numerous security issues to do with the portal and the modelling work for MoSeS and Junaid is our lead on addressing these.
- To this end Junaid has produced a literature review of relevant security and an implementation of a very important part of the security for MoSeS.
- Both of these things are very useful for us.
- The implementation frees us from concerns over accidentally granting access to users that have not accepted special conditions for the data they are viewing. It also allows a means of accessing the MoSeS portal via a shibboleth authentication easing the management of users accounts.
- The literature review includes a formulation of security requirements for e-Social Science projects and a review of security mechanisms to address these.
- It identifies a number of other security technologies that we can use for MoSeS.
- Limitations in Shibboleth are identified and options for enhacement (additional constraints and flexibility) are outlined including VOMS, CAS, PERMIS and Globus-based techniques e.g. GridShib, ShibGrid, SHEBANGS etc.
- Additionally Junaid has gone some way towards implementing a PERMIS solution for securing data in an archive (accessible via a portlet).
- Background to the Shibboleth based security system put in place for MoSeS
- Some of the data are specially licensed on an individual basis:
- The base population data is derived from UK Census data that is specially licensed.
- MoSeS developers do not want to be set up as another authority for this.
-
- Operationally, MoSeS developers did not want a system that required a large overhead in managing user accounts.
- The users of MoSeS portlets might come from myriad organisations; academic institutions (research councils, universities), Primary Care Trusts, Local Councils etc...
- What we wanted for MoSeS was a security Authentication Authorisation Access system in place which controlled what users of the MoSeS Portal could view, whilst being as open as possible and allowing them to see what portlets (functionailty) were available.
- The use of Shibboleth and UK e-Science Certificates seemed the way forward for this.
- It is our understanding that Junaid has delivered such a system which fully meets this security requirement.
- This has involved setting MoSeS up as a Service Provider (SP), liasing with ISS at Leeds (Nigel Bruce) and configuring an apache web server.
- All the detials of Junaid's work should be included in his final write up which will be made available to us and we look forward to reading it.
-
- Browsing
- OGC Grid Collision, NCeSS e-Infrastructure, MoSeS
- MoSeS
- Beowulf processing check:
- Completed 80001 to 90000 although nodes 1213, 206, 204, 203 and 202 are dead so potential problems there...
- Started 90001 to 100000.
- Processing OAs for IPS-GA comparison
- This will take a few days at least...
-
- Browsing
- OGC Grid Collision, NCeSS e-Infrastructure, MoSeS
-
- Browsing
- Research Interest
- OGC Grid Collision, NCeSS e-Infrastructure, MoSeS
- MoSeS
- Automating generation of MoSeS Web Content...
- Beowulf processing check:
- Received and written result with 99 HSARDataRecords and 68 ISARDataRecords for 00MRNC0002 with fitness 17.39534331585906937190
- Sending input 86485 with ZoneCode 00MRNC0030 to 12
-
- Browsing
- Got myOpenID.
- Started myExperiment.
- OGC Grid Collision, NCeSS e-Infrastructure, MoSeS
- Feature - SimCity, social engineering, and 60 million “people”
- NCeSS e-Infrastructure for the Social Sciences (NESS)
- AVROSS interview/meeting with Meik Poschen
- CREW: Collaborative Research Events on the Web
- Source-to-Output Repositories (StORe)
- Core Questions
- Background and Involvement with CI/e-Infrastructure
- Please tell me about your (academic) background and/or role in the project
- e-Infr has been understood in various ways, could you describe your understanding of the e-Infr framework?
- Let's suppose it is an organisation comprising of hardware, software, data and people and other organisation parts.
- e-Infr framework is what supports e-Research (e-Science) it is like a human body is for the mind of a person.
- The most important part of any organisation is the people.
- The organisation is the information flow.
- Please describe your involvement with e-Infr
- I am developing various Free and Open Source Software. I am collaborating on numerous other projects and open to further collaboration.
- Background of the project: How was your project established?
- Technology
- Many technologies have been associated with e-Infr over the years. What technologies are used and/or developed by your project?
- Do you in any way support learning, training or documentation processes in your project?
- I think so, but nothing I am directly involved with.
- What is the relationship between the project and e-Infr technology stakeholders, such as infrastructure or middleware projects (i.e. Teragrid, Globus)?
- What were the technological constraints you have encountered during the project?
- For MoSeS it has become clear that there is insufficient computational power available on trusted resources for anything like what we want to do.
- We are not aware of a secure enough solution to processing confidential data on hardware external to the UK.
- Community Structure and Mobilization
- What user and/or developer communities are involved in your project?
- Developers
- There are four developers on MoSeS; Mark, Belinda, Paul and me. We are not really working on the same code base. In the main our development (aside of system configuration) is in Java (there is some database work too). Paul, Belinda and I are working largely independently and Mark is acting to interface by providing data dummies derived from his own bespoke data manipulations.
- Users
- We have a health care planning application focus for Leeds involving Justin Keen and Leeds Primary Care Trust.
- We have a transportation research application that involves Haibo Chen.
- We have a business application that involves Martin Clarke.
- How are members of these communities recruited and how are they organized?
- Martin, Haibo and Justin were all involved in MoSeS at the proposal stage. Each of these are the interface with the application areas. However, now that web content is maturing, new avenues for collaboration are finding the core developers directly.
- How do participants interact, and how do these interactions feed back to the work process?
- Communications are in face to face meetings, by phone and increasingly via email and web content.
- How do project team members learn what happens elsewhere in the project?
- We have irregular meetings where we report on progress at two levels; a management level and a technical level.
- I blog most activity so much is picked up there.
- Paul and I regularly communicate via email and face to face.
- In what ways are you or others in your project connected with other related efforts in the US/UK/Europe (country) or elsewhere?
- Talk to Paul about CROWN and Collab - ongoing research collaboration between the University of Leeds (UK) and the University of Beihang (China).
- In what ways did related developments - either in the US/UK/Europe (country) or elsewhere - influence the work done in project?
- Adoption
- Are the developed e-Infr currently used today? Have they been adopted by others outside of the project?
- Yes. Not yet as far as I am aware.
- What do you think are the major catalysts that are helpful to get the approach adopted by people in the wider community?
- What are the obstacles to get the approach adopted by people in wider scientific community?
- Restrictive data licensing and security concerns.
- Impact
- When you arrive to the office today how is your work different than it was prior to the project?
- What do you think should be considered the major measures of success of your project?
- If Paul and I are still working together in 3 years time.
- What are the main innovations coming out of the project(s)?
- What are the alternative paradigms in your field to these developments?
- What in your opinion has been the impact of your project to date?
- We have helped fix some porblems and engage with the e-Science community.
- What do you think is going to be impact of e-Infr in your field 5-10 years from now?
- Maybe by then it will be powerful enough to do some more interesting work.
- Personnel and Resources
- Is there a connection between research and teaching?
- What is the project budget?
- What are the main costs associated with the project?
- Have you assumed new approaches during the project for funding considerations?
- Yes, I think so:
- The NCeSS e-Infrastructure for the Social Sciences project has come to be.
- Paul Townend has contacted Google.
- We have a proposal in for a new NCeSS Node combining the strengths of GeoVUE and MoSeS to focus on urban modelling within the context of Generative e-Social Science.
- Change
- What components of the projects have changed from the original planning over the course of the project?
- None, although details were not specified and this has given some freedom to adopt and utilise new technology and approaches as they have become available.
- Policy Input
- What do you consider to be main successes and failures of your project?
- Success
- The main success is the collaboration particularly between Paul and me. I am now blogging. We have been productive!
- Failures
- Paul has recognised the benefits of blogging outweigh the costs and is to start, but has not as yet.
- Mark has recognised the benefits of blogging but does not think these will outweigh the costs for him.
- Belinda has been discouraged from blogging.
- Others directly involved in the project do not update web content regularly.
- Do you have any recommendations to policymakers regarding funding, areas of interest, new calls, or other issues?
- Do you have additional thoughts about the subjects discussed in this interview, or are there other issues you think that study should address?
- Yes, this exercise can be viewed as an olive branch, a cry for help and a collaboration opportunity. I am making one of the subjects this interview itself thus activating introspection.
- Why not use MyExperiment and some of the Social Networking tools like Facebook (and the third part interview application) for this work?
- References and follow up
- Could you please refer me to others associated with your project - other users or developers - who could contribute to this study?
- Yes, I can point you to some individuals for different types of contribution. (Whether they would participate is up to them of course.)
- I suggest you turn next to:
- As the study continues would it be possible for me to follow up with you for questions and clarifications?
-
- Browsing
- OGC
- Geomorphometry
- SoG
- OGC Grid Collision, NCeSS e-Infrastructure, MoSeS
- Meeting with Paul:
- Should do some preparation for AVROSS interview/meeting tomorrow
- Core Questions
- Background and Involvement with CI/e-Infrastructure
- Please tell me about your (academic) background and/or role in the project
- e-Infr has been understood in various ways, could you describe your understanding of the e-Infr framework?
- Please describe your involvement with e-Infr
- Background of the project: How was your project established?
- Technology
- Many technologies have been associated with e-Infr over the years. What technologies are used and/or developed by your project?
- Do you in any way support learning, training or documentation processes in your project?
- What is the relationship between the project and e-Infr technology stakeholders, such as infrastructure or middleware projects (i.e. Teragrid, Globus)?
- What were the technological constraints you have encountered during the project?
- Community Structure and Mobilization
- What user and/or developer communities are involved in your project?
- How are members of these communities recruited and how are they organized?
- How do participants interact, and how do these interactions feed back to the work process?
- How do project team members learn what happens elsewhere in the project?
- In what ways are you or others in your project connected with other related efforts in the US/UK/Europe (country) or elsewhere?
- In what ways did related developments - either in the US/UK/Europe (country) or elsewhere - influence the work done in project?
- Adoption
- Are the developed e-Infr currently used today? Have they been adopted by others outside of the project?
- What do you think are the major catalysts that are helpful to get the approach adopted by people in the wider community?
- What are the obstacles to get the approach adopted by people in wider scientific community?
- Impact
- When you arrive to the office today how is your work different than it was prior to the project?
- What do you think should be considered the major measures of success of your project?
- What are the main innovations coming out of the project(s)?
- What are the alternative paradigms in your field to these developments?
- What in your opinion has been the impact of your project to date?
- What do you think is going to be impact of e-Infr in your field 5-10 years from now?
- Personnel and Resources
- Is there a connection between research and teaching?
- What is the project budget?
- What are the main costs associated with the project?
- Have you assumed new approaches during the project for funding considerations?
- Change
- What components of the projects have changed from the original planning over the course of the project?
- Policy Input
- What do you consider to be main successes and failures of your project?
- Do you have additional thoughts about the subjects discussed in this interview, or are there other issues you think that study should address?
- References and follow up
- Could you please refer me to others associated with your project - other users or developers - who could contribute to this study?
- As the study continues would it be possible for me to follow up with you for questions and clarifications?
- Based on the questionairre for the AVROSS meeting we basically talked about all our collaboration and looked to the future including staffing of the NCeSS e-Infrastructure for the Social Sciences project.
- http://cms-dev2.fhso.ch/avross/avross
- http://www.geog.leeds.ac.uk/people/a.turner/events/NCeSS/NodeJamboree_e-InfrastructureProjectAwayDay2007/
- http://www.geog.leeds.ac.uk/people/a.turner/organisations/NCeSS/documentation/meetings/
- http://www.geog.leeds.ac.uk/people/a.turner/organisations/NCeSS/
- http://www.ncess.ac.uk/support/wiki/index.php/NCeSS_e-Infrastructure_Away_Day_2007-06-20
- http://www.ncess.ac.uk/support/wiki/index.php/Main_Page
- http://www.phdcomics.com/comics/archive/phd080607s.gif
- http://www.phdcomics.com/comics.php
- http://myexperiment.org/
- http://64.233.183.104/search?q=cache:ltoUC1YAy8EJ:www.semanticgrid.org/presentations/DDeRJISCtalk.html+myspace+for+scientists+southampton&hl=en&ct=clnk&cd=7&gl=uk&client=firefox-a
- MoSeS
- Published outputs for IPS GA Comparison:
- Beowulf processing check:
- Received and written result with 130 HSARDataRecords and 0 ISARDataRecords for 00MGNH0031 with fitness 5.59855548317756098402
- Sending input 84558 with ZoneCode 00MGNJ0019 to 20
- Browsing
- Grids
- Liaison with Magna Schmitt
- OGC Grid Collision, NCeSS e-Infrastructure, MoSeS
- GeoLinking IE
- Michael has worked out where the problem is with losing the attributes:
- It is a GDAS problem really...
- MoSeS
- Beowulf processing check:
- Received and written result with 130 HSARDataRecords and 124 ISARDataRecords for 00MDNE0019 with fitness 4.81965040632207914439
- Sending input 83432 with ZoneCode 00MENA0005 to 8
- NCeSS e-Infrastructure for the Social Sciences
- Liaison with Rob Allan about portal stuff
- Browsing
- DSOnline
- OGC Grid Collision, NCeSS e-Infrastructure, MoSeS
- GeoLinking telecon
- MoSeS
- Node 205 failed to boot mpjd
- Reconfigured... Node214 has MPJRuntimeException... Reconfigured...
- Download and write loader for CASKS013 on Education
- Differences between different countries.
- ...
- Browsing
- Reading
- OGC Grid Collision, NCeSS e-Infrastructure, MoSeS
- GeoLinking IE
- Paul found a problem with the shapefile from the GLS server when default (all) areas i.e. no specified GeoLinkIDs:
- The attribute is missing.
- Emailed Michael to ask if this is a bug.
- MoSeS
- Developing code for Regression reports of IPS and GA comparison runs...
-
- Strange case of Ellesmere Port again...
- Browsing
- OGC Grid Collision, NCeSS e-Infrastructure, MoSeS
- MoSeS
- Beowulf processing failure due to node kernel failures and a hardware fault:
- Developing code for Regression reports of IPS and GA comparison runs...
- Some of the Regression Plots Mark generated for our last two meetings were actually comparing all population against household reference persons, which is why their was a scale difference on the axes when we were expecting (hoping for) a line through Y=X?
![[Validate RDF]](http://www.geog.leeds.ac.uk/people/a.turner/images/rdf_w3c_button.gif "W3C RDF Validation")
![[Validate CSS]](http://www.geog.leeds.ac.uk/people/a.turner/images/vcss.gif "W3C CSS Validation")
![[An image of Andy Turner]](http://www.geog.leeds.ac.uk/people/a.turner/a.turner.png)
