(Course grading)
(Syllabus)
 
(53 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
{{CourseHeader
 
{{CourseHeader
     | code = 2-IKV-115a
+
     | code = 2-IKVa-115/18
 
     | title = Introduction to Computational Intelligence
 
     | title = Introduction to Computational Intelligence
 
}}
 
}}
Line 10: Line 10:
 
<!--
 
<!--
 
== News ==
 
== News ==
<!--'''Exam:''' The list of questions is [http://dai.fmph.uniba.sk/courses/ICI/ci-exam-questions.pdf here]. You will choose three questions (pseudo)randomly.
+
<!--'''Exam:''' The list of questions is [http://dai.fmph.uniba.sk/courses/ICI/ci-exam-questions.pdf here]. You will choose three questions (pseudo)randomly.-->
 
+
;16. 9. 2020
+
: We start (exceptionally) on Tuesday, 22nd September at 16:30 (there is no cognitive science seminar yet) <b>online</b>.-->
+
  
 
<!-- [[#Archív noviniek|Archív noviniek…]] -->
 
<!-- [[#Archív noviniek|Archív noviniek…]] -->
 
<!--b>Poznámka:</b> Aktualizované slajdy prednášok budú poskytované priebežne na stránke predmetu.-->
 
  
 
== Course schedule ==
 
== Course schedule ==
Line 29: Line 24:
 
|Lecture
 
|Lecture
 
|Monday
 
|Monday
|9:00 - 10:30
+
|10:40 - 12:10
|online
+
|I-9 / in room
 
|[[Igor Farkas|Igor Farkaš]]
 
|[[Igor Farkas|Igor Farkaš]]
 
|-
 
|-
 
|Seminar
 
|Seminar
 
|Thursday
 
|Thursday
|14:00 - 15:30
+
|13:10 - 14:40
|online
+
|i-23 / in room
|[[Endre Hamerlik]]  & [[Igor Farkas|Igor Farkaš]]
+
|[[Kristina Malinovska|Kristína Malinovská]]  
 
|}
 
|}
  
Line 43: Line 38:
  
 
{| class="alternative table-responsive"
 
{| class="alternative table-responsive"
!#
+
!week
 
!Date
 
!Date
 
!Topic
 
!Topic
Line 49: Line 44:
 
|-
 
|-
 
|1.
 
|1.
|22.09.  
+
|Mon 26.09.  
|What is computational intelligence, basic concepts, relation to artificial intelligence.  [http://dai.fmph.uniba.sk/courses/ICI/References/ci-def.4x.pdf slides]
+
|What is computational intelligence, basic concepts, relation to artificial intelligence.  [http://dai.fmph.uniba.sk/courses/ICI/References/ci-def.4x.pdf slides] Seminar on Thursday.
|Craenen & Eiben (2003); [https://en.wikipedia.org/wiki/Computational_intelligence wikipedia]; R&N (2010), chap.1; Sloman (2002)
+
|Craenen & Eiben (2003); [https://en.wikipedia.org/wiki/Computational_intelligence wikipedia]; R&N (2010), chap.1;
 
|-
 
|-
 
|2.
 
|2.
|28.09.
+
|Mon 03.10.
|Taxonomy of artificial agents, nature of environments. [http://dai.fmph.uniba.sk/courses/ICI/References/ci-agents.4x.pdf slides]
+
|Taxonomy of artificial agents, nature of environments. [http://dai.fmph.uniba.sk/courses/ICI/References/ci-agents.4x.pdf slides] Seminar on Thursday.
 
|R&N (2010), chap.2
 
|R&N (2010), chap.2
 
|-
 
|-
 
|3.
 
|3.
|05.10.
+
|Mon 10.10.
|Inductive learning via observations, decision trees. Model selection. [http://dai.fmph.uniba.sk/courses/ICI/References/ci-learning.4x.pdf slides]
+
|Inductive learning via observations, decision trees. Model selection. [http://dai.fmph.uniba.sk/courses/ICI/References/ci-learning.4x.pdf slides] Seminar on Thursday.
 
|R&N (2010), ch.18.1-3,18.6; Marsland (2015), ch.12 <!--[http://www.r2d3.us/visual-intro-to-machine-learning-part-1/ DT visualization], [https://www.youtube.com/watch?v=LDRbO9a6XPU DT in python], [https://www.youtube.com/watch?v=2s3aJfRr9gE information entropy], [https://www.youtube.com/watch?v=EuBBz3bI-aA bias-variance tradeoff]-->
 
|R&N (2010), ch.18.1-3,18.6; Marsland (2015), ch.12 <!--[http://www.r2d3.us/visual-intro-to-machine-learning-part-1/ DT visualization], [https://www.youtube.com/watch?v=LDRbO9a6XPU DT in python], [https://www.youtube.com/watch?v=2s3aJfRr9gE information entropy], [https://www.youtube.com/watch?v=EuBBz3bI-aA bias-variance tradeoff]-->
 
|-
 
|-
 
|4.
 
|4.
|12.10.
+
|Mon 17.10.
|Supervised learning in feedforward neural networks (perceptrons), pattern classification, function approximation.  [http://dai.fmph.uniba.sk/courses/ICI/References/ci-fwdnn.4x.pdf slides]
+
|Supervised learning in feedforward neural networks (perceptrons), pattern classification, regression.  [http://dai.fmph.uniba.sk/courses/ICI/References/ci-fwdnn.4x.pdf slides] Seminar on Thursday.
 
|R&N (2010), ch.18.2; Marsland (2015), ch.3-4, Engelbrecht (2007), ch.2-3
 
|R&N (2010), ch.18.2; Marsland (2015), ch.3-4, Engelbrecht (2007), ch.2-3
 
|-
 
|-
 
|5.
 
|5.
|19.10.
+
|Mon 24.10.
|Unsupervised (self-organizing) neural networks: feature extraction, data visualization.  [http://dai.fmph.uniba.sk/courses/ICI/References/ci-unsup.4x.pdf slides]
+
|Unsupervised (self-organizing) neural networks: feature extraction, data visualization.  [http://dai.fmph.uniba.sk/courses/ICI/References/ci-unsup.4x.pdf slides] Seminar on Thursday.
 
|Marsland (2015), ch.14, Engelbrecht (2007), ch.4
 
|Marsland (2015), ch.14, Engelbrecht (2007), ch.4
 
|-
 
|-
 
|6.
 
|6.
|26.10.
+
|Mon 31.10.  
|Statistical learning, probabilistic models. [http://dai.fmph.uniba.sk/courses/ICI/References/ci-prob.4x.pdf slides]  
+
|No lecture (holiday)
|R&N (2010), ch.13,20.1-2
+
|Thursday - Lecture: Probability theory. Bayes formula. Naive Bayes classifier. R&N (2010), ch.13,20.1-2 [http://dai.fmph.uniba.sk/courses/ICI/References/ci-prob.4x.pdf slides]
|-
+
|
+
|02.11.
+
|Q&A - preparation for midterm
+
|Thursday: mid-term test
+
 
|-
 
|-
 
|7.
 
|7.
|09.11.
+
|Mon 7.11.
|Reinforcement learning I: basic principles and learning methods (TD-learning). Prediction problem.  [http://dai.fmph.uniba.sk/courses/ICI/References/ci-rl.4x.pdf slides]
+
|Seminar to lecture 6
|R&N (2010), ch.21.1-2.  
+
|Thursday - Lecture 7: Probabilistic learning: MAP, ML.  
 
|-
 
|-
 
|8.
 
|8.
|16.11.
+
|Mon 14.11.
|Reinforcement learning II (Q, SARSA), actor-critic, control problem, RL for continuous domains.
+
|Seminar to lecture 7 + Q&As before mid-term
|R&N (2010), ch.21.3-5; Woergoetter & Porr (2008).
+
|Tuesday: mid-term test
 
|-
 
|-
 
|9.
 
|9.
|23.11.
+
|Mon 21.11.
|Evolutionary computation: basic concepts, genetic algorithms. [http://dai.fmph.uniba.sk/courses/ICI/References/ci-evol.4x.pdf slides]
+
|Reinforcement learning I: basic principles and learning methods (TD-learning). Prediction problem. [http://dai.fmph.uniba.sk/courses/ICI/References/ci-rl.4x.pdf slides]
|Engelbrecht (2007), ch.8
+
|R&N (2010), ch.21.1-2.
 
|-
 
|-
 
|10.
 
|10.
|30.11.
+
|Mon 28.11.
|Fuzzy systems, fuzzy logic and reasoning. [http://dai.fmph.uniba.sk/courses/ICI/References/ci-fuzzy.4x.pdf slides]
+
|Reinforcement learning II (Q, SARSA), actor-critic, control problem, RL for continuous domains.
|Engelbrecht (2007), ch.20-21; Zadeh (2007)
+
|R&N (2010), ch.21.3-5.
 
|-
 
|-
 
|11.
 
|11.
|07.12.
+
|Mon 05.12.
|Explainable artificial intelligence (XAI). [http://dai.fmph.uniba.sk/courses/ICI/References/ci-xai.4x.pdf slides]
+
|Evolutionary computation: basic concepts, genetic algorithms. <!--[http://dai.fmph.uniba.sk/courses/ICI/References/ci-evol.4x.pdf slides]-->
 +
|Engelbrecht (2007), ch.8
 +
|-
 +
|12.
 +
|Mon 12.12.
 +
|Fuzzy systems, fuzzy logic and reasoning. <!--[http://dai.fmph.uniba.sk/courses/ICI/References/ci-fuzzy.4x.pdf slides]-->
 +
|Engelbrecht (2007), ch.20-21; Zadeh (2007)
 +
<!--
 +
|13.
 +
|14.12.
 +
|Explainable artificial intelligence (XAI) + Revision of main concepts. <!--[http://dai.fmph.uniba.sk/courses/ICI/References/ci-xai.4x.pdf slides]
 
|Barreto Arrieta A. et al. (2020)
 
|Barreto Arrieta A. et al. (2020)
|-
+
-->
|
+
|15.12.
+
|Summary, recap of main concepts, synergies.
+
|
+
 
|}
 
|}
 
Note: Dates refer to lectures, seminars will be on day+3 each week.
 
Note: Dates refer to lectures, seminars will be on day+3 each week.
  
 
== References ==
 
== References ==
 
+
<!--
 
* Barreto Arrieta A. et al. (2020). [https://doi.org/10.1016/j.inffus.2019.12.012 Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI]. Information Fusion, 58, pp. 82-115.
 
* Barreto Arrieta A. et al. (2020). [https://doi.org/10.1016/j.inffus.2019.12.012 Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI]. Information Fusion, 58, pp. 82-115.
 +
-->
 
* Craenen B., Eiben A. (2003): [http://dai.fmph.uniba.sk/courses/ICI/craenen.ci.enc03.pdf Computational Intelligence]. In: Encyclopedia of Life Support Sciences, EOLSS Publishers Co.
 
* Craenen B., Eiben A. (2003): [http://dai.fmph.uniba.sk/courses/ICI/craenen.ci.enc03.pdf Computational Intelligence]. In: Encyclopedia of Life Support Sciences, EOLSS Publishers Co.
 
* Engelbrecht A. (2007). [http://dai.fmph.uniba.sk/courses/ICI/engelbrecht.comp-intel-intro.07.pdf Computational Intelligence: An Introduction] (2nd ed.), John Willey & Sons.
 
* Engelbrecht A. (2007). [http://dai.fmph.uniba.sk/courses/ICI/engelbrecht.comp-intel-intro.07.pdf Computational Intelligence: An Introduction] (2nd ed.), John Willey & Sons.
 
* Russell S., Norwig P. (2010). [http://dai.fmph.uniba.sk/courses/ICI/References/russell-norvig.AI-modern-approach.3ed.2010.pdf Artificial Intelligence: A Modern Approach], (3rd ed.), Prentice Hall. Available in the faculty library.
 
* Russell S., Norwig P. (2010). [http://dai.fmph.uniba.sk/courses/ICI/References/russell-norvig.AI-modern-approach.3ed.2010.pdf Artificial Intelligence: A Modern Approach], (3rd ed.), Prentice Hall. Available in the faculty library.
 
* Marsland S. (2015). [http://dai.fmph.uniba.sk/courses/ICI/References/marsland.machine-learning.2ed.2015.pdf  Machine Learning: An Algorithmic Perspective], (2nd ed.), CRC Press.
 
* Marsland S. (2015). [http://dai.fmph.uniba.sk/courses/ICI/References/marsland.machine-learning.2ed.2015.pdf  Machine Learning: An Algorithmic Perspective], (2nd ed.), CRC Press.
* Sloman A. (2002). [http://www.cs.bham.ac.uk/research/projects/cogaff/sloman.turing.irrelevant.pdf The Irrelevance of Turing Machines to AI]. In Scheutz M. (ed.): Computationalism: New Directions, MIT Press, Cambridge, MA, pp. 87–127.
+
<!--* Woergoetter F., Porr B. (2008). [http://www.scholarpedia.org/article/Reinforcement_learning Reinforcement learning], Scholarpedia, 3(3):1448.-->
* Woergoetter F., Porr B. (2008). [http://www.scholarpedia.org/article/Reinforcement_learning Reinforcement learning], Scholarpedia, 3(3):1448.
+
 
* Zadeh L. (2007). [http://www.scholarpedia.org/article/Fuzzy_logic Fuzzy logic], Scholarpedia, 3(3):1766.
 
* Zadeh L. (2007). [http://www.scholarpedia.org/article/Fuzzy_logic Fuzzy logic], Scholarpedia, 3(3):1766.
  
 
== Course grading ==
 
== Course grading ==
  
* Active participation during the lectures/exercises (35%): 15 for lectures, 20 for exercises.  
+
* Active participation during the lectures/exercises (25%): 15 for lectures, 10 for exercises. Minimum 1/3 of points required.
* Written mid-term test (30%).
+
* Homework (10%): weekly homework given and discussed at the exercises, usually solved by hand or via excel sheets (no programming necessary)
* Final oral exam (30%): you will choose 3 questions, minimum of 1/3 of all points required. We will discuss 3 randomly chosen (by a computer) questions that basically correspond to weekly topics during the semester.
+
* Written mid-term test (30%), covering topics of the first half of the semester.
* Small final project (10%) = implementation of a small neural network (using an existing Python library) and writing a short report. Note: even without this, the student can still get maximum points if s/he has performed very actively. Deadline: 17th January, 2021.
+
* Final written-oral exam (30%): We will discuss 3 randomly chosen (by a computer) questions that basically correspond to weekly topics during the semester. Minimum of 1/3 of all points required.
 +
* Small final project (10%) = implementation of a small neural network (using an existing Python library) and writing a short report. Note: even without this, the student can still get maximum points if s/he has performed very actively. <b>Deadline: TBA</b>
 
* <b>Overall grading:</b> A (>90%), B (>80%), C (>70%), D (>60%), E (>50%), Fx (otherwise).
 
* <b>Overall grading:</b> A (>90%), B (>80%), C (>70%), D (>60%), E (>50%), Fx (otherwise).

Latest revision as of 21:28, 21 November 2022

Introduction to Computational Intelligence 2-IKVa-115/18

The course objectives are to make the students familiar with basic principles of various computational methods of data processing that can commonly be called computational intelligence (CI). This includes mainly bottom-up approaches to solutions of (hard) problems based on various heuristics (soft computing), rather than exact approaches of traditional artificial intelligence based on logic (hard computing). Examples of CI are nature-inspired methods (artificial neural networks, evolutionary algorithms, fuzzy systems), as well as probabilistic methods and reinforcement learning. After the course the students will be able to conceptually understand the important terms and algorithms of CI, and choose appropriate method(s) for a given task. The theoretical lectures are combined with the seminar where the important concepts will be discussed and practical examples will be shown.


Course schedule

Type Day Time Room Lecturer
Lecture Monday 10:40 - 12:10 I-9 / in room Igor Farkaš
Seminar Thursday 13:10 - 14:40 i-23 / in room Kristína Malinovská

Syllabus

week Date Topic References
1. Mon 26.09. What is computational intelligence, basic concepts, relation to artificial intelligence. slides Seminar on Thursday. Craenen & Eiben (2003); wikipedia; R&N (2010), chap.1;
2. Mon 03.10. Taxonomy of artificial agents, nature of environments. slides Seminar on Thursday. R&N (2010), chap.2
3. Mon 10.10. Inductive learning via observations, decision trees. Model selection. slides Seminar on Thursday. R&N (2010), ch.18.1-3,18.6; Marsland (2015), ch.12
4. Mon 17.10. Supervised learning in feedforward neural networks (perceptrons), pattern classification, regression. slides Seminar on Thursday. R&N (2010), ch.18.2; Marsland (2015), ch.3-4, Engelbrecht (2007), ch.2-3
5. Mon 24.10. Unsupervised (self-organizing) neural networks: feature extraction, data visualization. slides Seminar on Thursday. Marsland (2015), ch.14, Engelbrecht (2007), ch.4
6. Mon 31.10. No lecture (holiday) Thursday - Lecture: Probability theory. Bayes formula. Naive Bayes classifier. R&N (2010), ch.13,20.1-2 slides
7. Mon 7.11. Seminar to lecture 6 Thursday - Lecture 7: Probabilistic learning: MAP, ML.
8. Mon 14.11. Seminar to lecture 7 + Q&As before mid-term Tuesday: mid-term test
9. Mon 21.11. Reinforcement learning I: basic principles and learning methods (TD-learning). Prediction problem. slides R&N (2010), ch.21.1-2.
10. Mon 28.11. Reinforcement learning II (Q, SARSA), actor-critic, control problem, RL for continuous domains. R&N (2010), ch.21.3-5.
11. Mon 05.12. Evolutionary computation: basic concepts, genetic algorithms. Engelbrecht (2007), ch.8
12. Mon 12.12. Fuzzy systems, fuzzy logic and reasoning. Engelbrecht (2007), ch.20-21; Zadeh (2007)

Note: Dates refer to lectures, seminars will be on day+3 each week.

References

Course grading

  • Active participation during the lectures/exercises (25%): 15 for lectures, 10 for exercises. Minimum 1/3 of points required.
  • Homework (10%): weekly homework given and discussed at the exercises, usually solved by hand or via excel sheets (no programming necessary)
  • Written mid-term test (30%), covering topics of the first half of the semester.
  • Final written-oral exam (30%): We will discuss 3 randomly chosen (by a computer) questions that basically correspond to weekly topics during the semester. Minimum of 1/3 of all points required.
  • Small final project (10%) = implementation of a small neural network (using an existing Python library) and writing a short report. Note: even without this, the student can still get maximum points if s/he has performed very actively. Deadline: TBA
  • Overall grading: A (>90%), B (>80%), C (>70%), D (>60%), E (>50%), Fx (otherwise).