Human Generated Data

Title

Untitled (eight guests sitting at Bar Mitzvah banquet table)
Date

1948
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9221

Human Generated Data

Title

Untitled (eight guests sitting at Bar Mitzvah banquet table)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9221

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.8
Apparel 99.8
Person 99.4
Human 99.4
Person 98.4
Person 96.1
Person 95
Person 94
Table 92.7
Furniture 92.7
Person 90
Meal 87
Food 87
Gown 85.1
Fashion 85.1
Dining Table 85
Sunglasses 85
Accessories 85
Accessory 85
Robe 83.9
Face 81.8
Person 81.2
Sunglasses 81.2
Sunglasses 78.8
Overcoat 75.5
Coat 75.5
Suit 75.5
Wedding 75.1
Clinic 73.7
Dish 73.6
Female 71.9
Person 71.8
Indoors 68.5
Chair 67
Plant 66.7
Wedding Gown 66.3
Person 65.8
Portrait 65.2
Photo 65.2
Photography 65.2
Glass 64.2
Bridegroom 63.9
People 61.6
Person 58.9
Woman 57.8
Room 57.7
Bride 56.9
Person 46

Clarifai
created on 2023-10-26

people 99.8
monochrome 98.6
group 98.6
adult 98.2
man 97.5
group together 94.7
woman 94.5
many 92.2
medical practitioner 92.2
several 89.1
wear 83.5
administration 79.3
war 74.1
military 74.1
scientist 71.5
three 70.8
leader 70.2
room 69.5
furniture 68.8
facial expression 68

Imagga
created on 2022-01-23

patient 55.6
person 53.3
man 37
people 36.8
surgeon 32.6
case 31
sick person 30.6
male 28.4
room 25.8
nurse 24.6
specialist 24.4
adult 23.3
medical 23
work 22.8
office 22.5
professional 22.4
hospital 21.1
doctor 20.7
coat 20.5
businessman 20.3
indoors 20.2
men 19.7
worker 19.6
sitting 18.9
home 18.3
working 17.7
hairdresser 17.4
team 17
business 17
lab coat 16.4
computer 16
health 16
medicine 15.9
businesswoman 15.4
happy 15
women 15
group 14.5
laboratory 14.5
smiling 14.5
talking 14.3
teamwork 13.9
table 13.8
occupation 13.7
lab 13.6
desk 13.2
meeting 13.2
couple 13.1
portrait 12.9
clinic 12.6
job 12.4
senior 12.2
corporate 12
laptop 11.8
research 11.4
together 11.4
businesspeople 11.4
biology 11.4
human 11.2
student 11.1
salon 11
indoor 11
lifestyle 10.8
scientist 10.8
smile 10.7
colleagues 10.7
profession 10.5
illness 10.5
color 10
modern 9.8
science 9.8
life 9.7
to 9.7
technology 9.7
test 9.6
30s 9.6
education 9.5
barbershop 9.4
two 9.3
instrument 9.3
suit 9
interior 8.8
looking 8.8
conference 8.8
chemistry 8.7
exam 8.6
casual 8.5
horizontal 8.4
mature 8.4
equipment 8.4
care 8.2
shop 8.1
cheerful 8.1
family 8
happiness 7.8
chemical 7.8
two people 7.8
assistant 7.8
scientific 7.8
uniform 7.6
communication 7.6
executive 7.5
study 7.5
manager 7.4
holding 7.4
inside 7.4
successful 7.3
confident 7.3
face 7.1
love 7.1

Google
created on 2022-01-23

Black 89.6
Black-and-white 85.1
Style 83.9
Art 82.9
Adaptation 79.2
Chair 76.6
Tints and shades 76.5
Snapshot 74.3
Vintage clothing 74.1
Monochrome photography 73.5
Monochrome 72.1
Bottle 71.8
Event 71.1
Painting 70.9
Visual arts 69.5
Font 68.9
Table 68
Room 67.1
History 65.4
Stock photography 63.3

Microsoft
created on 2022-01-23

text 99.4
bottle 90.9
table 88.5
window 86.4
wedding 77.4
clothing 75.7
vase 64.7
person 62.1
clothes 51.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 99.6%
Calm 99.9%
Happy 0%
Sad 0%
Confused 0%
Angry 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 91.8%
Calm 91.8%
Sad 3.9%
Happy 1.8%
Surprised 1.2%
Confused 0.5%
Disgusted 0.4%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 99.1%
Angry 0.3%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Sad 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 95.4%
Calm 87.6%
Happy 9.1%
Sad 1.7%
Surprised 0.8%
Disgusted 0.4%
Confused 0.3%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 33-41
Gender Male, 97.6%
Surprised 89%
Angry 3.1%
Calm 2.2%
Happy 2.1%
Confused 1.2%
Disgusted 1%
Sad 0.9%
Fear 0.3%

AWS Rekognition

Age 28-38
Gender Female, 63.2%
Calm 98.9%
Happy 0.9%
Confused 0.1%
Sad 0.1%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Calm 90.5%
Confused 4.1%
Happy 1.4%
Sad 1.2%
Surprised 1.1%
Disgusted 0.6%
Fear 0.6%
Angry 0.4%

AWS Rekognition

Age 26-36
Gender Male, 54.1%
Happy 23.7%
Surprised 23.2%
Calm 18.3%
Confused 17.3%
Fear 6.1%
Sad 5.3%
Angry 3.9%
Disgusted 2.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Sunglasses 85%

Text analysis

Amazon

MJ13
MJ13 YT33A2
YT33A2
$ 7805

Google

230 S MIL3 YI33A2 00A
230
S
MIL3
YI33A2
00A