Human Generated Data

Title

Untitled (family eating fancy dinner in dining room with server in background)

Date

1958

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9608

Human Generated Data

Title

Untitled (family eating fancy dinner in dining room with server in background)

People

Artist: Martin Schweig, American 20th century

Date

1958

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99
Person 97.9
Person 97.8
Person 97.6
Person 97
Sitting 91.2
Furniture 81.5
Indoors 81.5
Room 81.5
Table 81.1
Clothing 78.2
Apparel 78.2
Accessories 76.7
Accessory 76.7
Sunglasses 76.7
Tabletop 74.2
Restaurant 73.5
Food 73.4
Meal 73.4
Dining Table 69.1
Crowd 68.6
Person 67.4
People 66.2
Dish 62.6
Cafeteria 56.5
Coat 56.3
Suit 56.3
Overcoat 56.3
Bar Counter 56
Pub 56
Workshop 55.6

Imagga
created on 2022-01-23

man 48.4
specialist 47.8
people 39.6
senior 38.4
male 37.6
person 34.7
computer 26.5
adult 26.4
room 25.6
home 24.7
men 23.2
sitting 22.3
elderly 22
couple 21.8
nurse 20.9
retired 20.4
office 20.2
smiling 19.5
mature 19.5
classroom 19.3
indoors 19.3
retirement 19.2
surgeon 18.8
happy 18.8
working 18.5
teacher 18.5
laptop 18.3
together 17.5
work 17.3
old 16.7
patient 16.6
portrait 14.9
education 14.7
table 14.7
teaching 14.6
business 14.6
hospital 14.1
lifestyle 13.7
worker 13.4
medical 13.2
businessman 13.2
meeting 13.2
professional 13.1
student 12.8
class 12.5
occupation 11.9
active 11.5
technology 11.1
health 11.1
women 11.1
casual 11
businesswoman 10.9
school 10.7
group 10.5
talking 10.4
doctor 10.3
learning 10.3
communication 10.1
holding 9.9
70s 9.8
modern 9.8
monitor 9.8
older 9.7
looking 9.6
husband 9.5
illness 9.5
grandfather 9.5
businesspeople 9.5
college 9.5
wife 9.5
desk 9.4
teamwork 9.3
glasses 9.2
camera 9.2
hand 9.1
care 9.1
to 8.8
executive 8.8
studying 8.6
married 8.6
smile 8.5
adults 8.5
board 8.1
team 8.1
handsome 8
job 8
medicine 7.9
discussing 7.9
40s 7.8
color 7.8
conversation 7.8
corporate 7.7
two 7.6
reading 7.6
help 7.4
equipment 7.2
chair 7.2
happiness 7

Google
created on 2022-01-23

Black 89.6
Table 87.7
Black-and-white 86.3
Style 84
Chair 81.8
Font 79.3
Automotive design 76.4
Monochrome photography 76.1
Monochrome 75.9
Event 73
T-shirt 72.8
Eyewear 69.2
Suit 68.1
Room 67.9
Sitting 66.5
Stock photography 65.5
Crowd 63
Conversation 61.4
Team 60.3
Tableware 59.5

Microsoft
created on 2022-01-23

person 99.9
text 93.9
clothing 93.4
man 84.9
people 70.6
group 69
black and white 51.2

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 77.5%
Calm 97.3%
Sad 1.3%
Confused 0.3%
Disgusted 0.3%
Fear 0.3%
Angry 0.2%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 29-39
Gender Male, 87.6%
Happy 33.6%
Surprised 23.9%
Calm 22.7%
Fear 7%
Sad 3.6%
Angry 3.2%
Disgusted 3.2%
Confused 2.8%

AWS Rekognition

Age 30-40
Gender Female, 62.5%
Fear 68.5%
Happy 12%
Calm 11.5%
Sad 4.3%
Angry 2.1%
Confused 0.8%
Disgusted 0.4%
Surprised 0.4%

AWS Rekognition

Age 28-38
Gender Female, 61.8%
Calm 99.8%
Happy 0.1%
Disgusted 0%
Sad 0%
Angry 0%
Confused 0%
Surprised 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Sunglasses 76.7%

Captions

Microsoft

a group of people sitting at a table 95.4%
a group of people sitting around a table 95.3%
a group of people sitting at a table in a restaurant 93.7%

Text analysis

Amazon

25V25

Google

MJI7--YT3RA
MJI7--YT3RA 2--XAGO
2--XAGO