Human Generated Data

Title

Untitled (business men at meeting, library)

Date

c.1940

People

Artist: Harris & Ewing, American 1910s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22320

Human Generated Data

Title

Untitled (business men at meeting, library)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

c.1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 99.7
Human 99.7
Chair 99.6
Furniture 99.6
Person 99.5
Person 99.3
Person 99.2
Person 99.1
Person 99
Person 98.7
Person 98
Chair 97.2
Person 96
Room 94.5
Indoors 94.5
Person 94.5
Person 88.4
School 83.6
Classroom 79.6
Sitting 75.5
Cafeteria 72.1
Restaurant 72.1
Person 68.9
Floor 62.4
Shelf 59.3
Chair 59.1
Flooring 58.2
Book 56.2
Library 56.2

Imagga
created on 2022-03-11

barbershop 100
shop 100
mercantile establishment 84.5
place of business 56.4
indoors 31.6
establishment 28.2
people 27.9
chair 27.5
man 26.2
men 25.8
male 22.7
sitting 20.6
adult 20.5
women 19
office 18.9
room 18.8
business 18.2
person 18.2
smiling 17.4
table 17.3
businessman 16.8
inside 16.6
home 15.9
interior 15.9
happy 15
senior 15
work 14.9
indoor 14.6
lifestyle 14.4
corporate 13.7
together 13.1
couple 13.1
mature 13
seat 12.9
computer 12.8
barber chair 12.5
meeting 12.2
teamwork 12
team 11.6
working 11.5
talking 11.4
desk 11.3
communication 10.9
restaurant 10.5
group 10.5
portrait 10.3
executive 10.1
occupation 10.1
furniture 10.1
salon 9.9
modern 9.8
old 9.7
cheerful 9.7
job 9.7
life 9.6
love 9.5
two 9.3
professional 9.3
back 9.2
classroom 9
worker 9
middle aged 8.8
two people 8.7
building 8.7
hairdresser 8.1
hospital 7.9
medical 7.9
day 7.8
smile 7.8
happiness 7.8
chairs 7.8
conference 7.8
architecture 7.8
businessmen 7.8
40s 7.8
colleagues 7.8
illness 7.6
patient 7.6
bed 7.6
businesspeople 7.6
togetherness 7.5
horizontal 7.5
phone 7.4
laptop 7.3
businesswoman 7.3
success 7.2
color 7.2
travel 7

Google
created on 2022-03-11

Photograph 94.1
Black 89.5
Table 88.5
Black-and-white 85.5
Style 84
Suit 79.5
People 78.2
Monochrome photography 76.6
Monochrome 75.4
Chair 75.3
Building 74.2
Event 70.7
Room 68.4
Art 67.6
Vintage clothing 66.2
History 65.5
Sitting 64.8
Stock photography 61.8
Class 57.5
Window 56.2

Microsoft
created on 2022-03-11

text 96.8
table 95.3
outdoor 94.8
furniture 93.4
chair 89
person 87.2
clothing 74.1
man 69.5

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Female, 92%
Calm 99.4%
Sad 0.4%
Angry 0.1%
Happy 0%
Disgusted 0%
Surprised 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 83.1%
Calm 97.4%
Sad 1.2%
Happy 0.9%
Confused 0.3%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 25-35
Gender Female, 79%
Sad 71.4%
Calm 19.1%
Angry 2.7%
Confused 2.3%
Fear 2.3%
Surprised 1.2%
Disgusted 0.6%
Happy 0.4%

AWS Rekognition

Age 25-35
Gender Male, 98.2%
Sad 60.7%
Calm 30.3%
Confused 3.6%
Surprised 2.7%
Happy 1.4%
Disgusted 0.6%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 37-45
Gender Male, 80.9%
Sad 33.6%
Calm 29.6%
Confused 12.1%
Surprised 9.7%
Disgusted 6.5%
Happy 4.3%
Angry 2.3%
Fear 2%

AWS Rekognition

Age 36-44
Gender Male, 99.6%
Sad 97.4%
Calm 1.9%
Happy 0.2%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0%
Surprised 0%

AWS Rekognition

Age 18-24
Gender Male, 80.5%
Confused 32.8%
Calm 30.5%
Disgusted 16.1%
Happy 10.5%
Sad 4%
Fear 2.7%
Angry 2.4%
Surprised 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Chair 99.6%

Captions

Microsoft

a group of people sitting on a bench 71.5%
a group of people sitting in chairs in front of a building 71.4%
a group of people sitting on a bench in front of a building 67%