Human Generated Data

Title

Untitled (people in uniform posing in grocery store)

Date

1951-1952

People

Artist: Orrion Barger, American active 1913 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6300

Human Generated Data

Title

Untitled (people in uniform posing in grocery store)

People

Artist: Orrion Barger, American active 1913 - 1984

Date

1951-1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.5
Human 99.5
Person 99.4
Face 99.3
Person 99.3
Person 99.2
Person 99.2
Person 99.1
Person 98.9
Person 98.4
Person 98.4
Person 98.3
Person 97.2
Apparel 97.1
Clothing 97.1
Person 95.9
Person 95.5
Person 95.3
Person 93.6
Person 93.1
Helmet 91.6
Person 91.3
Person 87.4
Person 86.2
Smile 84.7
People 84
Person 83.1
Overcoat 80.7
Suit 80.7
Coat 80.7
Helmet 78.8
Head 78.1
Crowd 76.7
Photography 76.6
Portrait 76.6
Photo 76.6
Meal 76.1
Food 76.1
Person 75.8
Furniture 74.9
Chair 73.5
Helmet 73.5
Helmet 71.1
Plant 69.2
Helmet 68.8
Accessory 66.2
Glasses 66.2
Accessories 66.2
Helmet 62.9
Sunglasses 61.7
Man 59.2
Table 59
Female 58.3
Beard 57.3
Audience 55.1

Imagga
created on 2022-01-22

man 34.4
person 32.9
people 30.6
male 29.8
classroom 26
businessman 23.8
business 23.7
men 23.2
room 22.1
adult 19.5
brass 19.2
group 18.5
team 17
teacher 16.5
silhouette 15.7
student 14.8
blackboard 14.5
couple 13.9
education 13.8
wind instrument 13.8
office 13.7
success 13.7
gymnasium 13
human 12.7
diagram 12.4
black 12.1
hand 12.1
teaching 11.7
school 11.4
meeting 11.3
happy 11.3
smiling 10.8
idea 10.7
athletic facility 10.6
chart 10.5
musical instrument 10.5
world 10.1
portrait 9.7
spectator 9.5
night 8.9
looking 8.8
cornet 8.7
women 8.7
30s 8.6
professional 8.6
facility 8.6
youth 8.5
teamwork 8.3
life 8.3
board 8.1
family 8
trombone 8
sport 7.9
work 7.8
drawing 7.7
crowd 7.7
finance 7.6
plan 7.6
communication 7.5
sign 7.5
graphic 7.3
celebration 7.2
financial 7.1
job 7.1
planner 7

Google
created on 2022-01-22

Photograph 94.2
Coat 88.5
Font 78.8
Suit 75
Snapshot 74.3
Event 71.4
Team 71.3
Room 69.3
Crew 69.3
Monochrome 68.2
History 68.1
Vintage clothing 66.5
Hat 65.4
Uniform 63.8
Stock photography 61.7
Class 59.1
Monochrome photography 51.8

Microsoft
created on 2022-01-22

person 99.6
text 98.8
posing 96.7
outdoor 95.2
group 76.3
clothing 63.8
man 58.3
old 48.4
crowd 2.4

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 96.9%
Calm 63.4%
Happy 26.4%
Surprised 4.2%
Angry 3.9%
Sad 0.6%
Disgusted 0.6%
Confused 0.5%
Fear 0.3%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Calm 94.5%
Happy 2.6%
Surprised 1.1%
Angry 0.5%
Sad 0.5%
Disgusted 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 97.8%
Happy 0.8%
Sad 0.6%
Surprised 0.3%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 31-41
Gender Male, 100%
Happy 36.3%
Calm 33.6%
Surprised 25.3%
Sad 2.1%
Disgusted 1.2%
Confused 0.8%
Angry 0.5%
Fear 0.2%

AWS Rekognition

Age 29-39
Gender Male, 98.5%
Calm 90.2%
Happy 5.7%
Angry 1.9%
Surprised 0.9%
Sad 0.6%
Disgusted 0.4%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Happy 81.5%
Surprised 7.7%
Calm 6.1%
Angry 1.4%
Sad 1.1%
Confused 1%
Disgusted 1%
Fear 0.3%

AWS Rekognition

Age 38-46
Gender Male, 99.2%
Calm 61.7%
Surprised 12.8%
Sad 7.8%
Disgusted 5%
Angry 5%
Happy 4.6%
Confused 2.3%
Fear 0.8%

AWS Rekognition

Age 48-56
Gender Female, 90.9%
Happy 93.8%
Sad 2.5%
Calm 2.1%
Confused 0.8%
Surprised 0.3%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Calm 99.5%
Happy 0.2%
Surprised 0.1%
Sad 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Male, 80.1%
Surprised 91.7%
Calm 2.9%
Happy 2.5%
Fear 1.4%
Disgusted 0.6%
Angry 0.4%
Sad 0.3%
Confused 0.1%

AWS Rekognition

Age 35-43
Gender Male, 99.6%
Calm 56.4%
Happy 43.2%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%
Angry 0%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Calm 57.4%
Happy 26.7%
Sad 4.8%
Fear 3.1%
Surprised 2.9%
Confused 2.1%
Disgusted 1.5%
Angry 1.4%

AWS Rekognition

Age 35-43
Gender Male, 89%
Calm 78.7%
Happy 20.3%
Sad 0.3%
Angry 0.3%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 98.4%
Calm 90.6%
Happy 8.9%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 99.7%
Happy 86.1%
Calm 11%
Surprised 0.7%
Angry 0.7%
Fear 0.6%
Sad 0.5%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 16-22
Gender Male, 100%
Calm 78.7%
Surprised 5.9%
Sad 5.8%
Happy 5.4%
Angry 1.7%
Disgusted 1%
Confused 1%
Fear 0.5%

AWS Rekognition

Age 47-53
Gender Male, 62%
Happy 68.8%
Calm 27.9%
Sad 1.6%
Disgusted 0.9%
Confused 0.3%
Fear 0.3%
Surprised 0.2%
Angry 0.1%

AWS Rekognition

Age 23-31
Gender Male, 52%
Calm 79.7%
Happy 4.8%
Sad 3.9%
Fear 2.9%
Disgusted 2.8%
Surprised 2.7%
Confused 1.9%
Angry 1.2%

AWS Rekognition

Age 31-41
Gender Male, 98.1%
Calm 75.4%
Happy 15.9%
Surprised 2.8%
Disgusted 2.6%
Sad 1.3%
Confused 0.7%
Fear 0.7%
Angry 0.6%

AWS Rekognition

Age 43-51
Gender Male, 97.5%
Calm 97.9%
Happy 1.6%
Sad 0.3%
Disgusted 0.1%
Angry 0.1%
Surprised 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Helmet 91.6%
Sunglasses 61.7%

Captions

Microsoft

a group of people posing for a photo 96.5%
a group of people posing for the camera 96.4%
a group of people posing for a picture 96.3%

Text analysis

Amazon

FLAKES
Treet
LEAST
CASIONS
AT LEAST
FROSTED
AT
GO
WEEK
ONCE
SCORES
OUT
FOR...
SNOWM
A WEEK
DINE OUT
WAFFLE
am
A
CUPLETS
SCORES HIGH/
DINE
AM
and
SUGAR
HIGH/
D
GRAPEFRUIT
CETS GO FOR...
Kellogg's
PPE D
REINDEER
PPE
CORSAGE
CETS
and For Parties
-
Sausage
For
CREAM
10-57
Parties
T
Sausage PORK
as
MALL
CENTERPICE
as 1
NAGOY
MALL LIBEATHE
1
LAESE
PORK
LAESE GREATHS
LIBEATHE
GREATHS
use

Google

Treet SCORES HIGH/ Cers Go FOR SUGAR FROSTED FLAKES DINE OUT AT LEAST ONCE A WEEK Lavfile EAM CASIONS WMONG LARGE LREATAS REINDEER CINTERPACE GORSAG GRAPEFRUIT
HIGH/
Go
FOR
OUT
AT
A
WMONG
GORSAG
GRAPEFRUIT
FROSTED
REINDEER
CINTERPACE
SUGAR
DINE
ONCE
WEEK
EAM
CASIONS
LARGE
FLAKES
LEAST
Lavfile
Treet
SCORES
Cers
LREATAS