Human Generated Data

Title

Untitled (group portrait of kitchen staff members in school kitchen)

Date

1955-1957

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9594

Human Generated Data

Title

Untitled (group portrait of kitchen staff members in school kitchen)

People

Artist: Martin Schweig, American 20th century

Date

1955-1957

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 98.6
Person 98.6
Person 98.5
Person 98.2
Person 98.2
Person 97.1
Person 96.8
Person 96.6
Apparel 94.4
Clothing 94.4
Person 93.7
Person 92.8
Coat 89.5
Overcoat 89.5
Person 81.5
Suit 77.4
Restaurant 75.9
Footwear 73.5
Shoe 73.5
Person 72.5
Person 69.1
Person 65
Furniture 62.2
Chair 62.2
Shop 59.1
Meal 58.1
Food 58.1
Cafe 57.2
Tuxedo 55.6
Shoe 53.2

Imagga
created on 2022-01-23

shop 79.9
barbershop 73.1
mercantile establishment 58.9
interior 58.3
home 39.9
place of business 39.2
room 39.1
modern 38.5
house 37.6
furniture 35.4
kitchen 33.2
table 28.7
counter 27.4
luxury 27.4
decor 25.6
inside 24.8
chair 24.4
indoor 22.8
floor 22.3
apartment 22
wood 21.7
indoors 21.1
glass 21
architecture 20.3
design 20.2
establishment 19.4
cabinet 19
light 18.7
stove 17.6
decoration 17.4
window 17
sink 16.7
style 15.6
restaurant 15.1
clean 15
nobody 14.8
residential 14.4
lamp 14.3
oven 14.1
contemporary 14.1
new 13.8
cook 13.7
tile 13.5
shoe shop 13.4
estate 13.3
living 13.3
steel 13.3
lifestyle 13
food 12.7
expensive 12.4
comfortable 12.4
3d 12.4
domestic 11.7
business 11.5
hotel 11.4
mirror 11.4
people 11.2
wall 11.1
island 11
man 10.7
real estate 10.7
stainless 10.7
office 10.6
building 10.5
real 10.4
buy 10.3
elegant 10.3
elegance 10.1
stylish 9.9
case 9.9
sofa 9.6
empty 9.4
faucet 8.9
urban 8.7
cooking 8.7
dining 8.6
bar 8.3
fashion 8.3
equipment 8.2
remodel 7.9
ceiling 7.9
carpet 7.8
bathroom 7.7
men 7.7
waiting 7.7
construction 7.7
industry 7.7
dinner 7.6
center 7.6
hairdresser 7.5
relaxation 7.5
rest 7.4
appliance 7.4
structure 7.3
work 7.1
life 7
wooden 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 90.2
black and white 89.2
clothing 89.1
window 84.9
text 77.6
building 56.5
store 34.3
bar 27.1
line 21.1

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Female, 56.3%
Happy 80.9%
Calm 7%
Sad 6%
Confused 3.5%
Surprised 1.3%
Angry 0.8%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 47-53
Gender Male, 99.8%
Calm 48.3%
Happy 37.2%
Sad 8.7%
Surprised 1.8%
Angry 1.3%
Disgusted 1%
Confused 1%
Fear 0.7%

AWS Rekognition

Age 26-36
Gender Male, 68.1%
Sad 72.5%
Calm 20.4%
Confused 4.2%
Happy 1.8%
Angry 0.4%
Fear 0.3%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 24-34
Gender Female, 66.1%
Calm 75.1%
Happy 8.2%
Confused 4.1%
Sad 3.3%
Fear 3.3%
Surprised 2.3%
Angry 2.3%
Disgusted 1.3%

AWS Rekognition

Age 36-44
Gender Female, 81.6%
Happy 45%
Confused 19.3%
Calm 15.8%
Sad 9.1%
Surprised 4.7%
Disgusted 3.7%
Angry 1.4%
Fear 1.1%

AWS Rekognition

Age 23-33
Gender Male, 55.7%
Calm 73.7%
Sad 7.7%
Angry 6.9%
Confused 4%
Happy 3.7%
Disgusted 1.8%
Fear 1.1%
Surprised 0.9%

AWS Rekognition

Age 45-51
Gender Male, 99.5%
Calm 84.8%
Happy 6.4%
Sad 4.4%
Confused 1.6%
Angry 1%
Surprised 0.8%
Disgusted 0.7%
Fear 0.3%

AWS Rekognition

Age 26-36
Gender Female, 85.6%
Calm 54.1%
Sad 19%
Confused 16.2%
Happy 4.7%
Fear 2%
Angry 1.5%
Surprised 1.3%
Disgusted 1.2%

AWS Rekognition

Age 39-47
Gender Male, 70.7%
Calm 54.3%
Sad 22.5%
Confused 19.9%
Happy 2.2%
Surprised 0.4%
Disgusted 0.3%
Fear 0.2%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Shoe 73.5%
Chair 62.2%

Captions

Microsoft

a group of people standing in front of a store window 82%
a group of people standing in front of a window 81.9%
a group of people standing in a store window 79.7%

Text analysis

Amazon

25181

Google

EGO
AMA EGO
AMA