Human Generated Data

Title

Untitled (woman and children around piano)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17952

Human Generated Data

Title

Untitled (woman and children around piano)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17952

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Person 99.7
Human 99.7
Person 99.6
Person 99.2
Person 99
Clinic 98.9
Person 98.8
Hospital 95.4
Operating Theatre 92.3
Doctor 57.2
Clothing 56.7
Apparel 56.7

Clarifai
created on 2023-10-29

people 99.8
group 99.2
man 98.6
adult 98.4
child 96.9
woman 96.2
group together 96.2
three 93.4
medical practitioner 93.1
leader 91
several 89.6
four 89.4
monochrome 89.1
indoors 88.6
education 88
boy 86
portrait 85.5
five 83.2
administration 81.9
facial expression 78.6

Imagga
created on 2022-03-04

nurse 100
patient 49.3
person 44
man 41.7
people 36.3
male 34.8
medical 33.6
professional 32.1
adult 29.5
doctor 29.2
coat 26.8
businessman 25.6
hospital 23.9
lab coat 23.8
health 23.6
case 23.6
team 23.3
worker 23.3
sick person 23.1
men 22.3
work 22
business 21.9
job 21.2
indoors 20.2
happy 19.4
medicine 19.4
office 19.3
smiling 18.8
teamwork 18.6
working 17.7
corporate 17.2
businesspeople 17.1
clinic 17
senior 16.9
couple 15.7
specialist 15.7
occupation 15.6
lab 15.6
sitting 15.5
businesswoman 15.5
laboratory 15.4
group 15.3
women 15
day 14.9
colleagues 14.6
meeting 14.1
table 13.9
room 13.8
scientist 13.7
illness 13.4
research 13.3
desk 13.2
lifestyle 13
indoor 12.8
40s 12.7
assistant 12.6
chemistry 12.6
color 12.2
bright 12.2
clothing 11.9
casual 11.9
suit 11.7
portrait 11.7
chemical 11.6
30s 11.6
care 11.5
talking 11.4
biology 11.4
face 11.4
education 11.3
looking 11.2
mature 11.2
science 10.7
test 10.6
elderly 10.5
standing 10.4
manager 10.2
happiness 10.2
two 10.2
student 10.1
holding 9.9
doctors 9.8
coworkers 9.8
50s 9.8
two people 9.7
scientific 9.7
technology 9.7
mid adult 9.7
together 9.6
angle 9.6
profession 9.6
adults 9.5
smile 9.3
focus 9.3
communication 9.2
successful 9.2
executive 9.1
human 9
70s 8.9
associates 8.9
forties 8.8
casual clothing 8.8
home 8.8
daytime 8.7
exam 8.6
instrument 8.5
modern 8.4
inside 8.3
20s 8.3
cheerful 8.1
surgeon 8.1
success 8
teacher 8
to 8
interior 8
equipment 7.9
chemist 7.9
days 7.8
surgery 7.8
expertise 7.8
sick 7.7
life 7.7
workplace 7.6
development 7.6
uniform 7.6
horizontal 7.5
clothes 7.5
emotion 7.4
treatment 7.4
confident 7.3
computer 7.2
look 7
attractive 7

Google
created on 2022-03-04

Shirt 93.8
Hat 89.6
Coat 85.4
Curtain 84.9
Picture frame 78.1
Vintage clothing 74.6
Service 74.4
Window 73.5
Health care 73.2
Monochrome photography 72.7
Monochrome 72
Health care provider 72
Event 71.9
Art 69.7
Room 66.5
Cooking 64.9
Medical 64.1
Medical assistant 64
Stock photography 63
History 61.8

Microsoft
created on 2022-03-04

clothing 96.6
human face 94.9
man 91.1
person 88.2
smile 78.1
text 75.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 74.4%
Happy 98.5%
Surprised 0.5%
Calm 0.4%
Fear 0.2%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 48-54
Gender Female, 96%
Calm 67.8%
Sad 19.6%
Happy 8.1%
Confused 1.4%
Disgusted 1.1%
Fear 0.7%
Surprised 0.7%
Angry 0.6%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Happy 91.7%
Sad 4.1%
Calm 2.5%
Surprised 0.5%
Confused 0.3%
Fear 0.3%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 6-14
Gender Male, 97.4%
Calm 53.4%
Happy 17.3%
Surprised 10.7%
Sad 7.7%
Angry 4%
Fear 3.7%
Disgusted 2.6%
Confused 0.7%

AWS Rekognition

Age 47-53
Gender Male, 99.2%
Happy 57.5%
Surprised 22.1%
Sad 10.7%
Angry 3.5%
Confused 1.9%
Disgusted 1.9%
Calm 1.4%
Fear 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.7%
Person 99.6%
Person 99.2%
Person 99%
Person 98.8%

Categories

Imagga

people portraits 74%
paintings art 23.5%

Text analysis

Amazon

KODAK-SVLELA
b

Google

10
10