Human Generated Data

Title

Untitled (woman standing in front of cake at banquet table filled with people at Jewish party)
Date

1948
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9996

Human Generated Data

Title

Untitled (woman standing in front of cake at banquet table filled with people at Jewish party)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9996

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Tie 100
Accessories 100
Accessory 100
Person 99.4
Human 99.4
Person 98.7
Person 98.4
Person 98.2
Person 98.1
Person 97.6
Person 97.1
Person 95.5
Clothing 94.6
Apparel 94.6
Furniture 90.4
Face 89.4
Helmet 87.5
Suit 84
Coat 84
Overcoat 84
Person 83.5
Indoors 80.9
Room 78.5
Tie 76.6
Table 73.9
Plant 73.8
People 73.5
Crowd 71
Chair 67.7
Photography 63.8
Photo 63.8
Tie 63.6
Sitting 58.8
Dining Table 57.4
Female 57.2
Art 57
Tuxedo 55.2
Person 44.8
Person 44.7

Clarifai
created on 2023-10-27

people 99.9
group 99
music 98.5
musician 96.8
leader 95.8
man 95.8
group together 95.1
monochrome 94.6
child 94.1
many 93.8
chair 93.2
adult 92.6
woman 91.3
singer 88.3
administration 87.4
several 87
family 83.7
furniture 82.3
audience 82.1
facial expression 81.9

Imagga
created on 2022-01-28

marimba 72.4
percussion instrument 62.1
musical instrument 49.4
man 41.6
male 40.4
people 35.7
person 33.9
happy 27.6
adult 27.5
office 26.7
businessman 26.5
room 26
group 25.8
men 25.7
table 25.3
smiling 24.6
classroom 24.4
business 24.3
women 23.7
meeting 22.6
blackboard 20.6
work 20.4
desk 20.1
smile 19.9
sitting 19.7
team 19.7
laptop 19.4
together 19.3
teacher 19.2
portrait 18.8
indoors 18.4
executive 18.4
worker 18
computer 16.9
modern 16.8
couple 16.5
education 16.4
businesswoman 16.4
professional 16.3
corporate 16.3
home 15.9
student 15.9
teamwork 15.8
job 15
lifestyle 14.4
suit 14.4
talking 14.2
senior 14
looking 13.6
class 13.5
manager 13
mature 13
indoor 12.8
school 12.6
businesspeople 12.3
successful 11.9
confident 11.8
board 11.7
communication 11.7
conference 11.7
teaching 11.7
interior 11.5
working 11.5
cheerful 11.4
chair 11.4
casual 11
leader 10.6
learning 10.3
happiness 10.2
house 10
holding 9.9
casual clothing 9.8
discussion 9.7
colleagues 9.7
success 9.7
boss 9.6
hall 9.4
study 9.3
two 9.3
handsome 8.9
students 8.8
standing 8.7
studying 8.6
togetherness 8.5
finance 8.4
new 8.1
to 8
paper 7.8
boy 7.8
color 7.8
glass 7.8
two people 7.8
mid adult 7.7
husband 7.6
hand 7.6
human 7.5
technology 7.4
children 7.3
clothing 7.2
bright 7.1
equipment 7.1
family 7.1

Google
created on 2022-01-28

Black 89.7
Plant 85.4
Black-and-white 85.3
Organism 85.2
Art 82.4
Rectangle 79.1
Monochrome photography 76.2
Snapshot 74.3
Monochrome 74.2
Font 74.2
Picture frame 73.7
Room 69.8
Painting 68.3
Visual arts 66.4
Event 65.6
History 64.9
Stock photography 64.2
Illustration 64.2
Photographic paper 59.6
Musical instrument 59.5

Microsoft
created on 2022-01-28

person 97.8
window 96.4
text 93.6
old 76.9
clothing 76.7
group 62.6
posing 62.6
man 55.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Sad 68.2%
Calm 19.4%
Angry 5.2%
Confused 2.3%
Surprised 2.1%
Happy 1.3%
Disgusted 1.1%
Fear 0.4%

AWS Rekognition

Age 35-43
Gender Male, 99.2%
Calm 95.3%
Disgusted 1.5%
Confused 1.1%
Sad 0.6%
Angry 0.4%
Surprised 0.4%
Happy 0.4%
Fear 0.1%

AWS Rekognition

Age 53-61
Gender Female, 93.9%
Happy 99.5%
Confused 0.1%
Calm 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 41-49
Gender Male, 97.5%
Happy 87%
Sad 11.6%
Disgusted 0.4%
Calm 0.2%
Angry 0.2%
Surprised 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Female, 60.7%
Calm 96.3%
Happy 3.4%
Surprised 0.1%
Disgusted 0%
Sad 0%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 49-57
Gender Male, 99.4%
Calm 94.2%
Sad 2.4%
Confused 1.2%
Disgusted 0.7%
Fear 0.6%
Angry 0.4%
Happy 0.3%
Surprised 0.3%

AWS Rekognition

Age 41-49
Gender Female, 60.3%
Calm 68.6%
Sad 26.4%
Confused 2.1%
Surprised 1.7%
Disgusted 0.5%
Angry 0.3%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Male, 99.1%
Calm 80.7%
Happy 5%
Sad 4.3%
Confused 3.1%
Angry 2.3%
Disgusted 2.1%
Surprised 2%
Fear 0.5%

AWS Rekognition

Age 7-17
Gender Male, 97.3%
Calm 63.5%
Sad 12.3%
Confused 8.4%
Angry 5.9%
Disgusted 5%
Happy 1.9%
Surprised 1.7%
Fear 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie
Person
Helmet
Tie 100%
Tie 76.6%
Tie 63.6%
Person 99.4%
Person 98.7%
Person 98.4%
Person 98.2%
Person 98.1%
Person 97.6%
Person 97.1%
Person 95.5%
Person 83.5%
Person 44.8%
Person 44.7%
Helmet 87.5%

Text analysis

Amazon

MUM
MUM YT3202 02240
YT3202
02240

Google

t 38 0S
t
38
0S