Human Generated Data

Title

Untitled (crowded schools)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16060

Human Generated Data

Title

Untitled (crowded schools)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Person 99.6
Human 99.6
Person 99.1
Person 98.9
Person 98.6
Person 98.6
Clothing 98.4
Footwear 98.4
Apparel 98.4
Shoe 98.4
Person 98.2
Person 96.6
Person 96.1
Clinic 95.7
Person 91.2
Furniture 86.3
Chair 86.3
Person 84.3
Hospital 83.9
Person 82.1
Shoe 81.7
People 64.1
Screen 61.8
Electronics 61.8
Monitor 61.8
Display 61.8
Military 61.6
Military Uniform 60.8
Operating Theatre 60.1
LCD Screen 58.6
Soldier 55.6
Shoe 55.2

Imagga
created on 2022-03-25

barbershop 90.5
shop 78.2
mercantile establishment 55.4
room 41.9
place of business 37
interior 36.3
office 27.5
chair 27.4
table 27
people 26.8
modern 24.6
work 24.3
man 24.2
indoors 23.7
classroom 22.1
person 21.3
business 21.3
male 20.6
home 20
professional 19.6
establishment 19.5
adult 18.6
hairdresser 17.8
furniture 17.3
hospital 17.1
computer 16.8
businessman 16.8
smiling 16.6
meeting 16
lifestyle 15.9
women 15.8
inside 15.7
indoor 15.5
team 15.2
restaurant 15.1
salon 15
working 15
corporate 14.6
group 14.5
desk 14.4
communication 14.3
house 14.2
patient 14.2
occupation 13.8
men 13.7
medical 13.2
design 13
happy 12.5
talking 12.4
kitchen 12.3
executive 12
suit 11.7
clinic 11.2
window 11.2
technology 11.1
teamwork 11.1
worker 11
wood 10.8
light 10.7
job 10.6
dining 10.5
sitting 10.3
food 10.3
service 10.2
businesswoman 10
nurse 10
decor 9.7
health 9.7
exam 9.6
comfortable 9.6
education 9.5
floor 9.3
dinner 9.3
laptop 9.1
life 9
seat 8.6
empty 8.6
doctor 8.5
portrait 8.4
mature 8.4
board 8.1
success 8.1
medicine 7.9
together 7.9
urban 7.9
glass 7.8
colleagues 7.8
3d 7.7
apartment 7.7
teacher 7.6
lamp 7.6
casual 7.6
elegance 7.6
fashion 7.5
contemporary 7.5
clothes 7.5
manager 7.5
holding 7.4
style 7.4
care 7.4
stylish 7.2
smile 7.1
counter 7.1

Google
created on 2022-03-25

Microsoft
created on 2022-03-25

person 96.5
clothing 93.6
indoor 93.4
furniture 86.8
man 81.3
table 76.5
text 75.3
chair 63.5

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 51.4%
Surprised 81.4%
Calm 6%
Disgusted 4.2%
Confused 3.6%
Sad 2.8%
Fear 1%
Happy 0.5%
Angry 0.5%

AWS Rekognition

Age 19-27
Gender Male, 98.8%
Calm 34.8%
Surprised 31.9%
Disgusted 21.8%
Confused 5.1%
Angry 3.7%
Sad 1.3%
Fear 0.9%
Happy 0.5%

AWS Rekognition

Age 35-43
Gender Male, 99.1%
Angry 54.8%
Confused 17.6%
Surprised 10.1%
Happy 9.6%
Calm 4.6%
Disgusted 1.4%
Sad 1.2%
Fear 0.8%

AWS Rekognition

Age 19-27
Gender Female, 85.9%
Sad 94.1%
Calm 4%
Disgusted 1%
Angry 0.3%
Confused 0.2%
Fear 0.2%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99.6%
Calm 91.8%
Sad 6.3%
Confused 1.2%
Angry 0.2%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Female, 97.5%
Calm 97.4%
Sad 1.8%
Confused 0.3%
Angry 0.3%
Surprised 0.1%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Sad 39.9%
Confused 32.1%
Calm 17.8%
Disgusted 4.5%
Surprised 2%
Angry 1.9%
Fear 1.2%
Happy 0.6%

AWS Rekognition

Age 24-34
Gender Female, 99.5%
Surprised 33.8%
Fear 15.9%
Disgusted 14.7%
Calm 13%
Sad 12.3%
Angry 6.3%
Confused 2.6%
Happy 1.4%

AWS Rekognition

Age 19-27
Gender Male, 99.5%
Calm 55.6%
Surprised 31%
Sad 4.5%
Confused 3.4%
Angry 2.7%
Disgusted 1.4%
Fear 1.2%
Happy 0.3%

AWS Rekognition

Age 48-56
Gender Male, 72.8%
Angry 32.6%
Calm 28.8%
Sad 22.8%
Confused 4.8%
Fear 3.3%
Disgusted 3.3%
Happy 2.3%
Surprised 2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 98.4%
Chair 86.3%

Captions

Microsoft

a group of people performing on a counter 93.1%
a group of people in a room 93%
a group of people standing in a room 92.9%

Text analysis

Amazon

12
SOCIAL
MJIR
MAOOX
also

Google

YT
12
MJI3
3R
A2
XAGOX
MJI3 YT 3R A2 XAGOX 12