Human Generated Data

Title

Untitled (man in suit standing behind soda fountain counter)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2549

Human Generated Data

Title

Untitled (man in suit standing behind soda fountain counter)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2549

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.6
Human 99.6
Chair 99.5
Furniture 99.5
Person 98.9
Person 98.7
Person 97.2
Person 96.2
Meal 94.6
Food 94.6
Person 94
Restaurant 90.8
Chair 90.6
Cafeteria 87.1
Person 86
Person 83.9
Chair 82.9
Chair 72.7
Lab 70.5
Person 64.8
Dish 60
Indoors 58.6
Room 56
Person 46.5

Clarifai
created on 2023-10-28

people 99.4
chair 98.5
furniture 97.7
room 97.4
indoors 97.2
man 96.5
seat 95.8
woman 95.6
desk 95.1
group 93.6
monochrome 93.3
adult 92
table 91.9
restaurant 89.8
group together 89.3
diner 89.1
stool 88.4
cafeteria 88.1
child 84.7
sit 84.7

Imagga
created on 2022-03-05

interior 67.2
room 54.8
counter 51.8
table 46.5
kitchen 43.3
furniture 41.5
house 40.1
home 39.1
chair 37.7
modern 35.1
decor 31
inside 30.4
dining 29.5
restaurant 28.7
design 28.1
floor 26
contemporary 25.4
shop 25.2
wood 25
barbershop 23.2
luxury 23.2
indoor 21.9
style 21.5
decoration 21
glass 19.9
indoors 19.3
apartment 19.2
cafeteria 18.8
architecture 18.8
mercantile establishment 18
stove 17.8
food 17.5
cook 17.4
comfortable 17.2
cabinet 16
dinner 16
light 15.4
window 14.8
chairs 14.7
residential 14.4
drink 14.2
tile 13.9
cabinets 13.8
oven 13.7
sink 13.7
stylish 13.6
cooking 13.1
barroom 12.9
elegant 12.9
stool 12.8
hotel 12.4
lamp 12.4
estate 12.3
empty 12
plant 11.9
place of business 11.7
seat 11.4
building 11.4
blackboard 11.3
drawer 10.9
hall 10.6
expensive 10.5
center 10.4
party 10.3
service 10.2
bar 10.2
nobody 10.1
elegance 10.1
domestic 9.9
salon 9.9
refrigerator 9.9
luxurious 9.7
meal 9.7
residence 9.7
stainless 9.7
wall 9.6
decorate 9.5
structure 9.2
eat 9.2
clean 9.2
tables 8.9
faucet 8.9
steel 8.8
hospital 8.5
office 8.5
lights 8.3
area 8.2
banquet 8.1
classroom 8
wooden 7.9
3d 7.7
setting 7.7
flower 7.7
real 7.6
living 7.6
island 7.3
metal 7.2
clinic 7

Google
created on 2022-03-05

Table 84
Style 83.8
Black-and-white 83.5
Building 79.5
Chair 72.5
Monochrome photography 70.9
Monochrome 70.7
Machine 69.9
Event 69.5
Room 68.6
Art 68.4
Science 60.4
Ceiling 58
Hall 56.9

Microsoft
created on 2022-03-05

indoor 97.7
wall 96.9
text 93.9
furniture 74.2
black and white 62.7
building 56
table 27.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 76.4%
Confused 45.3%
Calm 41%
Sad 3.6%
Fear 3.4%
Happy 2.8%
Disgusted 1.8%
Surprised 1.1%
Angry 1%

AWS Rekognition

Age 19-27
Gender Male, 74.1%
Calm 87.4%
Sad 7.2%
Confused 2.3%
Happy 1%
Angry 0.8%
Fear 0.6%
Disgusted 0.4%
Surprised 0.3%

AWS Rekognition

Age 38-46
Gender Male, 76.6%
Calm 54.7%
Sad 31.6%
Happy 5.2%
Confused 2.9%
Fear 1.7%
Disgusted 1.6%
Angry 1.3%
Surprised 1.1%

AWS Rekognition

Age 24-34
Gender Male, 52.9%
Sad 56%
Calm 23.9%
Happy 10%
Confused 6.3%
Angry 1.3%
Surprised 1%
Disgusted 0.9%
Fear 0.7%

AWS Rekognition

Age 23-31
Gender Female, 73.5%
Calm 38.3%
Happy 27%
Sad 17.1%
Confused 10.8%
Fear 2.4%
Disgusted 2.1%
Angry 1.4%
Surprised 1%

AWS Rekognition

Age 26-36
Gender Female, 58.6%
Sad 89.3%
Calm 3.2%
Happy 2.9%
Confused 2.4%
Disgusted 0.7%
Angry 0.6%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 30-40
Gender Female, 76.5%
Sad 36.7%
Happy 31.1%
Confused 13.5%
Calm 4.9%
Angry 4.3%
Fear 3.9%
Disgusted 3.8%
Surprised 1.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person
Chair
Person 99.6%
Person 98.9%
Person 98.7%
Person 97.2%
Person 96.2%
Person 94%
Person 86%
Person 83.9%
Person 64.8%
Person 46.5%
Chair 99.5%
Chair 90.6%
Chair 82.9%
Chair 72.7%

Categories

Imagga

interior objects 96.5%
streetview architecture 2.2%

Captions

Microsoft
created on 2022-03-05

a group of people in a room 81.6%
a group of people standing in a room 74.4%
a group of men in a room 68.6%

Text analysis

Amazon

Snacks
RICH
Fresh
BUTTER
Crisp- Fresh Snacks BUTTER
Crisp-
10
HICH
DOLLER HICH
DOLLER
MJIح
VT7702 MJIح
VT7702
ласко
ecour

Google

Crisp- BUTTER RICH
Crisp-
BUTTER
RICH