Human Generated Data

Title

Untitled (three children in costumes posed sitting in front of fireplace)

Date

1964

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10072

Human Generated Data

Title

Untitled (three children in costumes posed sitting in front of fireplace)

People

Artist: Martin Schweig, American 20th century

Date

1964

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 98.7
Human 98.7
Person 98.6
Person 98.4
Clothing 93.6
Apparel 93.6
Sitting 86.2
Face 74.5
Kid 73.8
Teen 73.8
Child 73.8
Blonde 73.8
Woman 73.8
Female 73.8
Girl 73.8
Indoors 70.1
Furniture 70
Monitor 68.2
Display 68.2
Screen 68.2
Electronics 68.2
People 67.8
Room 64.9
Table 64.7
Overcoat 64.5
Suit 64.5
Coat 64.5
Crowd 59.8
Studio 58.4

Imagga
created on 2022-01-28

television 100
telecommunication system 100
computer 36.4
laptop 33.8
office 31.3
broadcasting 29
man 28.9
business 28.5
adult 26.6
person 24.1
businessman 23.8
male 23.4
people 22.9
desk 22.7
telecommunication 21.6
work 20.4
working 20.3
happy 20
technology 20
monitor 18.8
professional 18.7
sitting 17.2
smile 17.1
education 15.6
corporate 15.5
looking 15.2
communication 15.1
smiling 14.5
medium 14.4
one 14.2
modern 14
manager 14
businesswoman 13.6
home 13.6
executive 12.9
indoor 12.8
classroom 12.6
notebook 12.6
room 11.8
equipment 11.6
job 11.5
screen 11.3
casual 11
blackboard 10.9
worker 10.7
class 10.6
indoors 10.5
pretty 10.5
tie 10.4
portrait 10.4
keyboard 10.3
men 10.3
occupation 10.1
child 10.1
face 9.9
school 9.9
hand 9.9
team 9.8
teacher 9.8
handsome 9.8
attractive 9.8
cheerful 9.7
interior 9.7
success 9.7
phone 9.2
alone 9.1
student 9.1
color 8.9
women 8.7
lifestyle 8.7
university 8.6
career 8.5
electronic 8.4
holding 8.2
confident 8.2
board 8.1
suit 8.1
group 8.1
chalkboard 7.8
expertise 7.8
employee 7.6
boss 7.6
finance 7.6
college 7.6
chair 7.6
contemporary 7.5
house 7.5
hospital 7.5
senior 7.5
shirt 7.5
mature 7.4
glasses 7.4
blond 7.2
happiness 7
together 7

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 99.3
black and white 91.2

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 90.5%
Surprised 87.8%
Calm 9.8%
Angry 0.7%
Fear 0.4%
Sad 0.4%
Disgusted 0.3%
Confused 0.3%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Female, 53.4%
Surprised 90.4%
Fear 6.3%
Calm 1.1%
Sad 0.7%
Disgusted 0.6%
Angry 0.4%
Happy 0.4%
Confused 0.1%

AWS Rekognition

Age 31-41
Gender Male, 96.1%
Happy 98.3%
Surprised 0.6%
Calm 0.4%
Angry 0.4%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a screen shot of a person 68%
a group of people on a screen 48.1%
a group of people looking at a screen 47%

Text analysis

Amazon

8
MAGON
3
А° г
MJI А° г НАВО
НАВО
(6)
7J17
MJI
7J17 TYPE
TYPE

Google

MJI3
2
NAGC
8.
A°2
8. MJI3 YI3 2 AAGON MJI3 YT 37 A°2 NAGC
YI3
YT
37
AAGON