Human Generated Data

Title

Untitled (women and men sitting at tables during Christmas ball)
Date

1960
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9682

Human Generated Data

Title

Untitled (women and men sitting at tables during Christmas ball)

People

Artist: Martin Schweig, American 20th century

Date

1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Furniture 100
Chair 100
Chair 99.8
Person 98.3
Human 98.3
Person 97.7
Person 97
Person 96
Sitting 95
Person 94.2
Person 88
Indoors 87.6
Room 83.1
Crowd 77.5
People 71
Photo 63.3
Photography 63.3
Portrait 60.6
Face 60.6
Audience 60.6
Couch 59.9
Press Conference 57.4
Court 57.1
Person 48.3

Imagga
created on 2022-01-23

room 64.7
classroom 59.2
table 39.3
office 37.5
meeting 34.9
business 33.4
group 32.3
people 31.3
man 30.9
person 30.1
businessman 29.2
businesswoman 28.2
team 27.8
professional 27
work 26.7
executive 26.7
sitting 26.6
male 26.3
laptop 24
women 23.7
adult 23.6
teacher 23.3
corporate 23.2
teamwork 22.3
modern 21.7
men 21.5
indoors 21.1
communication 21
businesspeople 19.9
worker 19.1
interior 18.6
together 18.4
talking 18.1
computer 17.8
working 17.7
happy 17.6
smiling 17.4
conference 16.6
desk 16.4
chair 16.2
education 15.6
manager 14.9
student 14.9
successful 14.6
indoor 14.6
colleagues 14.6
job 14.2
home 13.6
workplace 13.3
presentation 13
success 12.9
looking 12.8
discussion 12.7
collar 12.5
smile 12.1
hall 12.1
confident 11.8
suit 11.7
portrait 11.7
boss 11.5
happiness 11
lifestyle 10.8
entrepreneur 10.7
class 10.6
leader 10.6
friends 10.3
study 10.3
company 10.2
coffee 10.2
partners 9.7
couch 9.7
glass 9.3
musical instrument 9.2
board 9.1
director 9
cheerful 8.9
furniture 8.9
educator 8.9
restaurant 8.9
seminar 8.9
colleague 8.8
couple 8.7
corporation 8.7
sofa 8.7
casual 8.5
contemporary 8.5
learning 8.5
mature 8.4
employee 8.3
coworkers 7.9
paper 7.8
businessperson 7.8
drinking 7.7
ethnic 7.6
plan 7.6
pen 7.6
house 7.5
senior 7.5
holding 7.4
technology 7.4
phone 7.4
window 7.3
new 7.3
stringed instrument 7.1
handsome 7.1
day 7.1

Google
created on 2022-01-23

Furniture 93.7
Chair 90.8
Table 90.3
Curtain 84.9
Couch 82.9
Black-and-white 82.2
Picture frame 81
Suit 76.1
Art 73.5
Painting 70.8
Monochrome photography 70.6
Monochrome 69.1
Event 69
Font 68.7
Sitting 68
Room 67.6
Illustration 65.1
Coffee table 64.3
Window treatment 62.8
Stock photography 62.5

Microsoft
created on 2022-01-23

table 95
indoor 93.8
window 92.1
furniture 83.9
person 80.3
white 66.7
clothing 60.1
man 59.8
text 59.2
chair 55.4
computer 54.2
room 41.3

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 98.5%
Sad 40.8%
Happy 37.4%
Calm 9.1%
Confused 7.4%
Surprised 1.9%
Disgusted 1.7%
Angry 1.2%
Fear 0.5%

AWS Rekognition

Age 53-61
Gender Male, 99.5%
Happy 41.7%
Confused 22.5%
Sad 18.3%
Calm 11.7%
Fear 2.2%
Angry 1.3%
Surprised 1.1%
Disgusted 1.1%

AWS Rekognition

Age 42-50
Gender Male, 100%
Happy 87.7%
Sad 4.9%
Calm 3.4%
Confused 1.3%
Disgusted 1.2%
Angry 0.6%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 30-40
Gender Male, 78%
Calm 94.4%
Sad 4%
Confused 0.4%
Surprised 0.3%
Happy 0.3%
Angry 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Female, 71.1%
Happy 71%
Calm 11.7%
Confused 7.1%
Sad 5.4%
Surprised 1.6%
Disgusted 1.5%
Angry 0.9%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 100%
Person 98.3%

Captions

Microsoft

a group of people sitting in front of a window 88.8%
a group of people sitting at a desk in front of a window 88.7%
a group of people sitting in a room 88.6%

Text analysis

Amazon

thing
MJ17--YT3--OX
BMO35

Google

595
595