Human Generated Data

Title

Untitled (children, group portrait)
Date

c. 1970
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.598

Human Generated Data

Title

Untitled (children, group portrait)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.1
Human 99.1
Person 98.6
Person 98.5
Person 98.3
Person 98.2
Person 98.1
Person 97.6
Person 96.9
People 96.9
Person 96.1
Person 95.2
Person 93.9
Person 93.7
Person 93.3
Person 92.6
Person 91.6
Person 90.7
Family 90.4
Clothing 89.3
Apparel 89.3
Tree 82
Plant 82
Person 75.8
Meal 70.1
Food 70.1
Tie 67.9
Accessories 67.9
Accessory 67.9
Crowd 59.6
Sitting 56.7
Person 55.7
Photography 55.7
Photo 55.7

Imagga
created on 2022-01-09

kin 70.7
world 21.7
man 20.2
people 19
groom 18.7
park 16.5
person 15.7
portrait 15.5
male 12.9
bride 11.5
couple 11.3
old 11.1
outdoor 10.7
love 10.3
winter 10.2
statue 10.1
dark 10
dress 9.9
trees 9.8
summer 9.6
forest 9.6
men 9.4
art 9.2
adult 9.2
wedding 9.2
sport 9.2
travel 9.1
silhouette 9.1
outdoors 9
landscape 8.9
scene 8.7
married 8.6
happiness 8.6
play 8.6
face 8.5
black 8.4
uniform 8.1
history 8
sun 8
together 7.9
soldier 7.8
mask 7.8
tree 7.7
two 7.6
stone 7.6
happy 7.5
traditional 7.5
style 7.4
girls 7.3
protection 7.3
fall 7.2
smiling 7.2
sexy 7.2
family 7.1
grass 7.1
autumn 7

Google
created on 2022-01-09

Photograph 94.2
Black 89.6
Dress 89.5
Tree 88.4
Plant 85.4
Black-and-white 82.5
People in nature 81.3
Tints and shades 76.9
Monochrome 74.6
Monochrome photography 73.2
Vintage clothing 72.4
Family reunion 72.3
Event 71.8
Grass 71.7
Suit 70.7
History 64.4
Room 64.1
Sitting 64.1
Fun 63.7
Team 62.1

Microsoft
created on 2022-01-09

outdoor 99.7
tree 99.5
person 98.2
clothing 95.1
group 94
posing 91.4
woman 80.5
people 80.1
old 74.7
man 63.6
text 63.5
house 55.5
crowd 2.2

Face analysis

Amazon

Google

AWS Rekognition

Age 6-12
Gender Female, 100%
Happy 99.3%
Calm 0.1%
Fear 0.1%
Confused 0.1%
Surprised 0.1%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 2-8
Gender Male, 100%
Confused 41.1%
Happy 31.6%
Sad 15.9%
Calm 6.8%
Surprised 1.5%
Angry 1.4%
Disgusted 1.2%
Fear 0.5%

AWS Rekognition

Age 10-18
Gender Female, 100%
Happy 99.1%
Calm 0.2%
Sad 0.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 11-19
Gender Female, 100%
Calm 91.6%
Sad 6%
Happy 1.2%
Disgusted 0.5%
Confused 0.3%
Angry 0.3%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 29-39
Gender Male, 94.4%
Happy 84.1%
Fear 4.3%
Angry 4.2%
Disgusted 2.9%
Sad 1.9%
Surprised 1.1%
Calm 0.9%
Confused 0.6%

AWS Rekognition

Age 2-10
Gender Female, 66.9%
Happy 99.4%
Calm 0.5%
Confused 0%
Sad 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 11-19
Gender Male, 100%
Happy 90.7%
Calm 7.9%
Disgusted 0.3%
Sad 0.3%
Surprised 0.3%
Confused 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 9-17
Gender Female, 100%
Happy 98.1%
Confused 0.6%
Angry 0.3%
Disgusted 0.3%
Surprised 0.2%
Calm 0.2%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 6-14
Gender Female, 74.2%
Happy 99.9%
Calm 0%
Angry 0%
Sad 0%
Confused 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 6-14
Gender Female, 62.9%
Happy 99.9%
Confused 0%
Surprised 0%
Calm 0%
Sad 0%
Fear 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 2-10
Gender Female, 99.8%
Calm 84.2%
Angry 9.1%
Sad 2.4%
Confused 1.8%
Disgusted 1%
Happy 0.8%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 4-12
Gender Male, 59.2%
Happy 99.9%
Surprised 0%
Sad 0%
Angry 0%
Disgusted 0%
Calm 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 2-8
Gender Female, 98.4%
Sad 53.4%
Calm 43.8%
Surprised 0.9%
Angry 0.5%
Disgusted 0.4%
Fear 0.4%
Confused 0.3%
Happy 0.3%

AWS Rekognition

Age 6-14
Gender Female, 99.9%
Sad 70.1%
Happy 12.5%
Confused 6.7%
Calm 4.5%
Fear 2.3%
Disgusted 1.6%
Angry 1.2%
Surprised 1%

AWS Rekognition

Age 6-14
Gender Male, 85%
Happy 87.7%
Calm 7.7%
Sad 2.2%
Disgusted 0.7%
Surprised 0.7%
Confused 0.5%
Angry 0.4%
Fear 0.1%

AWS Rekognition

Age 6-14
Gender Female, 99.9%
Happy 99.5%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Calm 0.1%
Fear 0%

AWS Rekognition

Age 1-7
Gender Female, 100%
Sad 99%
Calm 0.9%
Disgusted 0.1%
Fear 0%
Angry 0%
Happy 0%
Confused 0%
Surprised 0%

AWS Rekognition

Age 0-4
Gender Female, 95.1%
Calm 67.3%
Angry 17.2%
Sad 6.5%
Happy 2.9%
Disgusted 2%
Fear 1.4%
Confused 1.3%
Surprised 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 67.9%

Captions

Microsoft

a group of people posing for a photo 98.8%
a group of people posing for the camera 98.7%
a group of people posing for a picture 98.6%